corejava25hours.com
robots.txt

Robots Exclusion Standard data for corejava25hours.com

Resource Scan

Scan Details

Site Domain corejava25hours.com
Base Domain corejava25hours.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-20T07:50:15+00:00
Next Scan 2025-08-19T07:50:15+00:00

Last Successful Scan

Scanned2025-06-20T19:32:18+00:00
URL https://corejava25hours.com/robots.txt
Domain IPs 178.16.136.39, 2a02:4780:11:1358:0:1ea6:374c:8
Response IP 178.16.136.39
Found Yes
Hash 1ec2e82de010855310500402a0e2b6d0fc57fadf0930dc11d1e7ffc2fad12bac
SimHash 400078004dba

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /feed/
Disallow /*/feed/
Disallow *?utm_source=rss
Disallow /amp/

Other Records

Field Value
sitemap https://corejava25hours.com/sitemap_index.xml

Comments

  • Block feed URLs from being crawled