youngwidow.blog
robots.txt

Robots Exclusion Standard data for youngwidow.blog

Resource Scan

Scan Details

Site Domain youngwidow.blog
Base Domain youngwidow.blog
Scan Status Ok
Last Scan2025-10-26T02:35:25+00:00
Next Scan 2025-11-09T02:35:25+00:00

Last Scan

Scanned2025-10-26T02:35:25+00:00
URL https://youngwidow.blog/robots.txt
Redirect https://www.youngwidow.blog/robots.txt
Redirect Domain www.youngwidow.blog
Redirect Base youngwidow.blog
Domain IPs 104.21.93.3, 172.67.201.187, 2606:4700:3030::ac43:c9bb, 2606:4700:3037::6815:5d03
Redirect IPs 104.21.93.3, 172.67.201.187, 2606:4700:3030::ac43:c9bb, 2606:4700:3037::6815:5d03
Response IP 104.21.93.3
Found Yes
Hash 51e81dec61bfda22144866d03b231b9946b3a2858ff46865893ef92b410b91f6
SimHash 258f5f747fd7

Groups

*

Rule Path
Disallow /_thumbs/
Disallow /api/
Disallow /cgi-bin/
Disallow /ckeditor/
Disallow /ckfinder/
Disallow /db-backups/
Disallow /ht-backups/
Disallow /galleria/
Disallow /includes/
Disallow /old/
Disallow /index.php*

Comments

  • robots : last updated Bob 150728
  • Disallow: /css/
  • Disallow: /images/
  • Disallow: /js/
  • http://www.robotstxt.org/wc/exclusion.html#robotstxt
  • http://tool.motoricerca.info/robots-checker.phtml