Log In Sign Up

automatedmarking.com
robots.txt

Robots Exclusion Standard data for automatedmarking.com

Resource Scan

Scan Details

Site Domain automatedmarking.com
Base Domain automatedmarking.com
Scan Status Ok
Last Scan2025-09-04T13:33:02+00:00
Next Scan 2025-10-04T13:33:02+00:00

Last Scan

Scanned2025-09-04T13:33:02+00:00
URL https://automatedmarking.com/robots.txt
Domain IPs 67.227.198.207
Response IP 67.227.198.207
Found Yes
Hash 94ace07e601055aabeae6582636b2f1468c465ebd12c2fc21448ecea5ae451c1
SimHash 691fd2824bba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 20

ahrefsbot

Rule Path
Disallow /

mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mozilla/5.0 (iphone; cpu iphone os 7_0 like mac os x) applewebkit/537.51.1 (khtml, like gecko) version/7.0 mobile/11a465 safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mozilla/5.0 (windows phone 8.1; arm; trident/7.0; touch; rv:11.0; iemobile/11.0; nokia; lumia 530) like gecko (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mj12bot

Rule Path
Disallow /

companybook-crawler

Rule Path
Disallow /

companybook

Rule Path
Disallow /

mozilla/5.0 (compatible; nimbostratus-bot/v1.3.2; http://cloudsystemnetworks.com)

Rule Path
Disallow /

pingdom gigrib (http://www.pingdom.com)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

pingdom.com_bot_version_1.4_(http://www.pingdom.com/)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

pingdom.com_bot_version_1.4_(http://www.pingdom.com)

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

pingdom.com

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

pingdom.com_bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

pingdom

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

pingdom gigrib

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Back to top

Comments

  • Block Ahrefs
  • Block Baidu
  • Delay Bing Bot
  • Block MJ12bot
  • Block Companybook-Crawler
  • Block Companybook-Crawler
  • Block Nimbostratus-bot
  • Delay Pingdom
  • Block SemrushBot
  • Block SeznamBot
  • Block ScoutJet
  • Block Yandex
Back to top