Log In Sign Up

media.justjared.com
robots.txt

Robots Exclusion Standard data for media.justjared.com

Resource Scan

Scan Details

Site Domain media.justjared.com
Base Domain justjared.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-05-27T09:32:00+00:00
Next Scan 2024-06-10T09:32:00+00:00

Last Successful Scan

Scanned2024-04-19T09:24:14+00:00
URL http://media.justjared.com/robots.txt
Domain IPs 104.18.2.201, 104.18.3.201, 2606:4700::6812:2c9, 2606:4700::6812:3c9
Response IP 104.18.3.201
Found Yes
Hash 86e88751fda3d50c66ea4e5ba7f39b335e8f21df2927ab0024990f8a0a931de3
SimHash 2e145d54378b

Groups

*

Rule Path
Disallow /*?s=*

bingbot

Rule Path
Disallow /*?s=*

googlebot

Rule Path
Disallow /*?s=*

grapeshot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.justjared.com/sitemapindex.xml
Back to top

Comments

  • BEGIN XML-SITEMAP-PLUGIN
  • ELI EDIT 11/08/2023
  • END XML-SITEMAP-PLUGIN
Back to top