apisbull.com
robots.txt

Robots Exclusion Standard data for apisbull.com

Resource Scan

Scan Details

Site Domain apisbull.com
Base Domain apisbull.com
Scan Status Ok
Last Scan2025-11-27T22:21:25+00:00
Next Scan 2025-12-04T22:21:25+00:00

Last Scan

Scanned2025-11-27T22:21:25+00:00
URL https://apisbull.com/robots.txt
Domain IPs 192.145.239.39
Response IP 192.145.239.39
Found Yes
Hash 29c43c83aa7c94b0aa873e942eb03dcc6541c330ac8419a14a2f0049cf300e57
SimHash 4239d9724391

Groups

*

Rule Path
Allow /
Disallow /blog/?feed=rss2

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

msnbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

yahoo!

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

ezooms

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

mj12bot

No rules defined. All paths allowed.

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

aihitbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

Warnings

  • 1 invalid line.