origin2-www.justjared.com
robots.txt

Robots Exclusion Standard data for origin2-www.justjared.com

Resource Scan

Scan Details

Site Domain origin2-www.justjared.com
Base Domain justjared.com
Scan Status Ok
Last Scan2024-05-06T01:39:32+00:00
Next Scan 2024-06-05T01:39:32+00:00

Last Scan

Scanned2024-05-06T01:39:32+00:00
URL https://origin2-www.justjared.com/robots.txt
Domain IPs 34.224.96.245, 44.205.80.216
Response IP 44.205.80.216
Found Yes
Hash 5487725f0af11b4243643c6bc58cd7419bfef62c2deb08d0c8de8ea4c76870e8
SimHash 0c145d5037d7

Groups

*

Rule Path
Disallow /*?s=*

bingbot

Rule Path
Disallow /*?s=*

googlebot

Rule Path
Disallow /*?s=*

grapeshot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.justjared.com/sitemapindex.xml

Comments

  • BEGIN XML-SITEMAP-PLUGIN
  • END XML-SITEMAP-PLUGIN