scpfamag.com
robots.txt

Robots Exclusion Standard data for scpfamag.com

Resource Scan

Scan Details

Site Domain scpfamag.com
Base Domain scpfamag.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-17T21:44:44+00:00
Next Scan 2026-02-15T21:44:44+00:00

Last Successful Scan

Scanned2023-01-08T12:26:23+00:00
URL https://scpfamag.com/robots.txt
Domain IPs 104.21.78.214, 172.67.137.161, 2606:4700:3033::6815:4ed6, 2606:4700:3035::ac43:89a1
Response IP 104.21.78.214
Found Yes
Hash 4ee629b8b738403cf28a75be8ddf87ad01043776f324d297b6e6286b3ddcc1eb
SimHash 6159d93571b3

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

*

Rule Path
Disallow /
Disallow /js/*
Disallow /wz/*
Disallow /index.php?*
Disallow /?*

Other Records

Field Value
sitemap https://scpfamag.com/sitemap.xml