Blocking bad link checker robots semrush, rogerbot, ahrefsbot,

nahuel

Piedra
Usuario de Piedra
Mensajes
71
Puntuación de reacción
2
Hola , tengo mi sitio web instalado "wordpress" Theme "astra" . Plugings: Elementor que es mi maqueteador y Yoast SEO, quiero bloquaer el acceso a los bot arañas semrush, rogerbot, ahrefsbot, intento hacerlo con .htaccess con este comando y no consigo resultado tambien lo hice desde robots.txt. con este otro comando y tampoo consigo resultado. mi hosting tiene IfModule mod_rewrite.c Activo intento de todo mi servidor es linux

Algun programador que me diga aguna soIucion tengo pagina 403 shtml
Asi es mi .htaccess:
Código:
<IfModule mod_rewrite.c>
    RewriteEngine On
    RewriteCond %{HTTP_USER_AGENT} ^BLEXBot [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^rogerbot [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-SA [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-BA [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-SI [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-SWA [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-CT [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-BM [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot-SEOAB [NC,OR]
    RewriteCond %{HTTP_USER_AGENT} ^SemrushBot [NC]
    RewriteCond %{HTTP_USER_AGENT} ^dotbot [NC,OR]
    RewriteRule ^.* - [F,L]
RewriteEngine on
RewriteCond %{HTTP_REFERER} SemrushBot [NC,OR]
RewriteCond %{HTTP_REFERER} SemrushBot-SA [NC,OR]
RewriteCond %{HTTP_REFERER} SemrushBot-BA [NC,OR]
RewriteCond %{HTTP_REFERER} SemrushBot-SI [NC,OR]
RewriteCond %{HTTP_REFERER} SemrushBot-SWA [NC,OR]
RewriteCond %{HTTP_REFERER} SemrushBot-CT [NC]
RewriteCond %{HTTP_REFERER} SemrushBot-BM [NC,OR]
RewriteCond %{HTTP_REFERER} SemrushBot-SEOAB [NC,OR]
RewriteCond %{HTTP_REFERER} rogerbot [NC]
RewriteCond %{HTTP_REFERER} dotbot [NC]
RewriteRule .* – [F,R=404.shtml]
</IfModule>
Options +FollowSymlinks
RewriteEngine On
RewriteBase /
SetEnvIfNoCase User-Agent "^SemrushBot" bad_user
Deny from env=bad_user
# BEGIN WordPress

RewriteEngine On
RewriteRule .* - [E=HTTP_AUTHORIZATION:%{HTTP:Authorization}]
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]

# END WordPress
informacion de sistema:
== Server Environment ==
Operating System: Linux
Software: Apache
MySQL version: MariaDB Server v10.3.29
PHP Version: 7.0.33
PHP Max Input Vars: 1000
PHP Max Post Size: 8M
GD Installed: Yes
ZIP Installed: Yes
Write Permissions: All right
Elementor Library: Connected


== Theme ==
Name: Astra
Version: 3.4.1
Author: Brainstorm Force
Child Theme: No

== User ==
Role: administrator
WP Profile lang: es_ES
User Agent: Mozilla/5.0 (Windows NT 6.3) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.93 Safari/537.36

== Active Plugins ==
Elementor
Version: 3.2.2
Author: Elementor.com

LoginPress - Customizing the WordPress Login
Version: 1.5.2
Author: WPBrigade

WordPress Importer
Version: 0.7
Author: wordpressdotorg

Yoast SEO
Version: 16.2
Author: Team Yoast


== Must-Use Plugins ==
installatron_hide_status_test.php
Version:
Author:


== Elementor - Compatibility Tag ==



== Elements Usage ==

wp-page : 3
button : 1
google_maps : 1
heading : 12
icon-box : 9
image : 3
image-gallery : 1
social-icons : 1
text-editor : 7
video : 1


== Log ==
 
Arriba