fabcrunch.com
robots.txt

Robots Exclusion Standard data for fabcrunch.com

Resource Scan

Scan Details

Site Domain fabcrunch.com
Base Domain fabcrunch.com
Scan Status Ok
Last Scan2024-09-17T02:53:21+00:00
Next Scan 2024-09-24T02:53:21+00:00

Last Scan

Scanned2024-09-17T02:53:21+00:00
URL https://fabcrunch.com/robots.txt
Domain IPs 13.35.185.116, 13.35.185.13, 13.35.185.22, 13.35.185.68
Response IP 13.33.88.78
Found Yes
Hash 4a596c779f604599f4776151c01a03cb915952efda86e6ed5132e94d0be67562
SimHash b02e53986390

Groups

*

Rule Path
Disallow /impressum/

amazonadbot

Rule Path
Disallow /*?*sub9=*&ref_id=*
Disallow /*?*network_code=IPW*