Log In Sign Up

brandmeesters.nl
robots.txt

Robots Exclusion Standard data for brandmeesters.nl

Resource Scan

Scan Details

Site Domain brandmeesters.nl
Base Domain brandmeesters.nl
Scan Status Ok
Last Scan2024-09-27T00:18:03+00:00
Next Scan 2024-10-27T00:18:03+00:00

Last Scan

Scanned2024-09-27T00:18:03+00:00
URL https://brandmeesters.nl/robots.txt
Domain IPs 5.200.15.131
Response IP 5.200.15.131
Found Yes
Hash c298ea708db18d83c0006f60a543e6560231aeec571c83041e9e36358e3b5905
SimHash 53558a53dbb7

Groups

jobdiggerspider

Rule Path
Disallow /

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

shopwiki

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

searchmetricsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

twengabot-2.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

*

Rule Path
Disallow /wp-admin/
Back to top

Other Records

Field Value
sitemap http://www.brandmeesters.nl/sitemap_index.xml
Back to top

Comments

  • http://www.jobdigger.nl/spider/ toegevoegd 16-10-2013
  • http://moz.com/help/pro/rogerbot-crawler toegevoegd 16-10-2013
  • http://www.majestic12.co.uk/projects/dsearch/mj12bot.php toegevoegd 16-10-2013
  • http://www.shopwiki.nl/w/Help%3ARobotshttp://www.jobdigger.nl/spider/ toegevoegd 16-10-2013
  • https://ahrefs.com/robot/ toegevoegd 16-10-2013
  • http://www.searchmetrics.com/en/searchmetrics-bot/ toegevoegd 16-10-2013
  • http://www.twenga.nl/bot.html toegevoegd 16-10-2013
  • http://help.yandex.com/webmaster/controlling-robot/robots-txt.xml toegevoegd 16-10-2013
  • Bing bot toegevoegd 22-01-2014
  • Bing bot toegevoegd 05-02-2014
  • wordpress regels
  • Sitemap index
Back to top