fabcrunch.com
robots.txt

Robots Exclusion Standard data for fabcrunch.com

Resource Scan

Scan Details

Site Domain fabcrunch.com
Base Domain fabcrunch.com
Scan Status Ok
Last Scan2024-11-13T04:46:25+00:00
Next Scan 2024-11-20T04:46:25+00:00

Last Scan

Scanned2024-11-13T04:46:25+00:00
URL https://fabcrunch.com/robots.txt
Domain IPs 13.35.210.101, 13.35.210.42, 13.35.210.75, 13.35.210.81
Response IP 13.35.210.101
Found Yes
Hash 4a596c779f604599f4776151c01a03cb915952efda86e6ed5132e94d0be67562
SimHash b02e53986390

Groups

*

Rule Path
Disallow /impressum/

amazonadbot

Rule Path
Disallow /*?*sub9=*&ref_id=*
Disallow /*?*network_code=IPW*