Log In Sign Up

scoopwhoop.com
robots.txt

Robots Exclusion Standard data for scoopwhoop.com

Resource Scan

Scan Details

Site Domain scoopwhoop.com
Base Domain scoopwhoop.com
Scan Status Ok
Last Scan2024-06-30T21:34:39+00:00
Next Scan 2024-07-07T21:34:39+00:00

Last Scan

Scanned2024-06-30T21:34:39+00:00
URL https://scoopwhoop.com/robots.txt
Redirect https://www.scoopwhoop.com/robots.txt
Redirect Domain www.scoopwhoop.com
Redirect Base scoopwhoop.com
Domain IPs 2600:9000:2721:2e00:5:ed2b:40c0:93a1, 2600:9000:2721:3200:5:ed2b:40c0:93a1, 2600:9000:2721:4800:5:ed2b:40c0:93a1, 2600:9000:2721:5000:5:ed2b:40c0:93a1, 2600:9000:2721:5600:5:ed2b:40c0:93a1, 2600:9000:2721:7800:5:ed2b:40c0:93a1, 2600:9000:2721:a000:5:ed2b:40c0:93a1, 2600:9000:2721:ba00:5:ed2b:40c0:93a1, 3.165.102.120, 3.165.102.31, 3.165.102.44, 3.165.102.72
Redirect IPs 18.67.181.23, 18.67.181.30, 18.67.181.52, 18.67.181.71, 2600:9000:2668:2200:5:ed2b:40c0:93a1, 2600:9000:2668:3600:5:ed2b:40c0:93a1, 2600:9000:2668:5200:5:ed2b:40c0:93a1, 2600:9000:2668:5c00:5:ed2b:40c0:93a1, 2600:9000:2668:7400:5:ed2b:40c0:93a1, 2600:9000:2668:7800:5:ed2b:40c0:93a1, 2600:9000:2668:7c00:5:ed2b:40c0:93a1, 2600:9000:2668:9600:5:ed2b:40c0:93a1
Response IP 3.165.102.31
Found Yes
Hash 22f3f39478f93638d09a606c1ea1d46c34486682874274a919b0ca19dbc28a14
SimHash 690158a1e7b3

Groups

*

Rule Path
Allow /
Disallow /?s=*
Disallow /ia%3D*
Disallow /rd/?url=*
Disallow /posh-policy.pdf*

aps-ad-standards-bot/1.0

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.scoopwhoop.com/sitemap.xml
sitemap https://www.scoopwhoop.com/news-sitemap.xml
Back to top