jagonews24.com
robots.txt
Robots Exclusion Standard data for jagonews24.com
Resource Scan
Scan Details
Site Domain | jagonews24.com |
Base Domain | jagonews24.com |
Scan Status | Ok |
Last Scan | 2024-11-01T11:28:53+00:00 |
Next Scan | 2024-11-08T11:28:53+00:00 |
Last Scan
Scanned | 2024-11-01T11:28:53+00:00 |
URL | https://jagonews24.com/robots.txt |
Redirect | https://www.jagonews24.com/robots.txt |
Redirect Domain | www.jagonews24.com |
Redirect Base | jagonews24.com |
Domain IPs | 104.20.78.239, 104.20.79.239, 2606:4700:10::6814:4eef, 2606:4700:10::6814:4fef |
Redirect IPs | 104.20.78.239, 104.20.79.239, 2606:4700:10::6814:4eef, 2606:4700:10::6814:4fef |
Response IP | 104.20.79.239 |
Found | Yes |
Hash | 03f4eb01acae102163dc348ff988144af32074abadf9b8b0e789fdef1a5b8d2b |
SimHash | 61088e7006d3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /21655469720 |
Disallow | /zero |
Disallow | /cgi-bin/ |
Disallow | /app/ |
Disallow | /api |
Disallow | /shell.html |
Disallow | /tmp/ |
Disallow | /junk/ |
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://www.jagonews24.com/sitemaps/index-sitemap.xml |