elsen.bidinside.com
robots.txt

Robots Exclusion Standard data for elsen.bidinside.com

Resource Scan

Scan Details

Site Domain elsen.bidinside.com
Base Domain bidinside.com
Scan Status Ok
Last Scan2025-08-16T15:07:39+00:00
Next Scan 2025-09-15T15:07:39+00:00

Last Scan

Scanned2025-08-16T15:07:39+00:00
URL https://elsen.bidinside.com/robots.txt
Domain IPs 104.20.28.61, 172.66.170.120, 2606:4700:10::6814:1c3d, 2606:4700:10::ac42:aa78
Response IP 104.20.28.61
Found Yes
Hash 6ffacd4f509169c560575f1e57fc6366f2edc4a91960e8ff0deb97f023b12f38
SimHash 19485b04c175

Groups

*
claudebot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

Warnings

  • 1 invalid line.