adblockplus.dev
robots.txt

Robots Exclusion Standard data for adblockplus.dev

Resource Scan

Scan Details

Site Domain adblockplus.dev
Base Domain adblockplus.dev
Scan Status Ok
Last Scan2024-06-04T15:24:57+00:00
Next Scan 2024-06-18T15:24:57+00:00

Last Scan

Scanned2024-06-04T15:24:57+00:00
URL https://adblockplus.dev/robots.txt
Domain IPs 104.21.65.228, 172.67.193.137, 2606:4700:3033::6815:41e4, 2606:4700:3034::ac43:c189
Response IP 104.21.65.228
Found Yes
Hash 3312cd12842d1fc0847e64405fae1abcf6ae21695ad0a31b83d99b27cc18a5d5
SimHash 8e04fa92a3f2

Groups

*

Rule Path
Disallow /textpattern/
Disallow /forum/adm/
Disallow /forum/download/
Disallow /forum/images/
Disallow /forum/includes/
Disallow /forum/language/
Disallow /forum/styles/
Disallow /forum/common.php
Disallow /forum/config.php
Disallow /forum/cron.php
Disallow /forum/faq.php
Disallow /forum/mcp.php
Disallow /forum/memberlist.php
Disallow /forum/posting.php
Disallow /forum/report.php
Disallow /forum/search.php
Disallow /forum/ucp.php
Disallow /forum/viewonline.php
Disallow /openid
Disallow /babelzilla.php
Disallow /getSubscription
Disallow /403.html
Disallow /_include/

linguee

Rule Path
Disallow /

mxbot

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Allow /

Warnings

  • 2 invalid lines.