abibitumi.com
robots.txt

Robots Exclusion Standard data for abibitumi.com

Resource Scan

Scan Details

Site Domain abibitumi.com
Base Domain abibitumi.com
Scan Status Ok
Last Scan2025-04-14T05:24:25+00:00
Next Scan 2025-04-28T05:24:25+00:00

Last Scan

Scanned2025-04-14T05:24:25+00:00
URL https://abibitumi.com/robots.txt
Domain IPs 104.21.20.143, 172.67.192.247, 2606:4700:3031::6815:148f, 2606:4700:3036::ac43:c0f7
Response IP 104.21.20.143
Found Yes
Hash 1663427326a26704e3a70ab92778ec7ff8a092ff7e3ed896a191cac39096e6ca
SimHash 68109802c336

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

bytespider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://abibitumi.com/sitemap-index.xml
sitemap https://abibitumi.com/sitemap-index-1.xml
sitemap https://abibitumi.com/sitemap.xml

Comments

  • This blocks Bytespider