Log In Sign Up

snopes.com
robots.txt

Robots Exclusion Standard data for snopes.com

Resource Scan

Scan Details

Site Domain snopes.com
Base Domain snopes.com
Scan Status Ok
Last Scan2024-05-21T22:29:52+00:00
Next Scan 2024-05-28T22:29:52+00:00

Last Scan

Scanned2024-05-21T22:29:52+00:00
URL https://snopes.com/robots.txt
Redirect https://www.snopes.com/robots.txt
Redirect Domain www.snopes.com
Redirect Base snopes.com
Domain IPs 18.155.68.115, 18.155.68.50, 18.155.68.89, 18.155.68.90, 2600:9000:23d2:5200:d:ae29:7b40:93a1, 2600:9000:23d2:7200:d:ae29:7b40:93a1, 2600:9000:23d2:7800:d:ae29:7b40:93a1, 2600:9000:23d2:8c00:d:ae29:7b40:93a1, 2600:9000:23d2:ae00:d:ae29:7b40:93a1, 2600:9000:23d2:c600:d:ae29:7b40:93a1, 2600:9000:23d2:ce00:d:ae29:7b40:93a1, 2600:9000:23d2:e000:d:ae29:7b40:93a1
Redirect IPs 18.155.68.115, 18.155.68.50, 18.155.68.89, 18.155.68.90, 2600:9000:23d2:2600:d:ae29:7b40:93a1, 2600:9000:23d2:3000:d:ae29:7b40:93a1, 2600:9000:23d2:4600:d:ae29:7b40:93a1, 2600:9000:23d2:5200:d:ae29:7b40:93a1, 2600:9000:23d2:6600:d:ae29:7b40:93a1, 2600:9000:23d2:7600:d:ae29:7b40:93a1, 2600:9000:23d2:7800:d:ae29:7b40:93a1, 2600:9000:23d2:bc00:d:ae29:7b40:93a1
Response IP 18.155.68.90
Found Yes
Hash 23029e827ab28299b251effe572bee5897d7fb93720d7bb6c7a59b7280856a56
SimHash c94c5830e713

Groups

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.snopes.com/sitemaps/sitemap-index.xml
sitemap https://www.snopes.com/sitemaps/sitemap-news.xml
Back to top