Log In Sign Up

justjared.com
robots.txt

Robots Exclusion Standard data for justjared.com

Resource Scan

Scan Details

Site Domain justjared.com
Base Domain justjared.com
Scan Status Ok
Last Scan2024-05-12T03:12:39+00:00
Next Scan 2024-05-19T03:12:39+00:00

Last Scan

Scanned2024-05-12T03:12:39+00:00
URL https://www.justjared.com/robots.txt
Domain IPs 104.18.2.201, 104.18.3.201, 2606:4700::6812:2c9, 2606:4700::6812:3c9
Response IP 104.18.2.201
Found Yes
Hash 86e88751fda3d50c66ea4e5ba7f39b335e8f21df2927ab0024990f8a0a931de3
SimHash 2e145d54378b

Groups

*

Rule Path
Disallow /*?s=*

bingbot

Rule Path
Disallow /*?s=*

googlebot

Rule Path
Disallow /*?s=*

grapeshot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.justjared.com/sitemapindex.xml
Back to top

Comments

  • BEGIN XML-SITEMAP-PLUGIN
  • ELI EDIT 11/08/2023
  • END XML-SITEMAP-PLUGIN
Back to top