mhtop.org
robots.txt

Robots Exclusion Standard data for mhtop.org

Resource Scan

Scan Details

Site Domain mhtop.org
Base Domain mhtop.org
Scan Status Ok
Last Scan2024-09-16T05:16:54+00:00
Next Scan 2024-09-23T05:16:54+00:00

Last Scan

Scanned2024-09-16T05:16:54+00:00
URL https://mhtop.org/robots.txt
Domain IPs 104.21.0.197, 172.67.128.61, 2606:4700:3030::6815:c5, 2606:4700:3033::ac43:803d
Response IP 172.67.128.61
Found Yes
Hash 51b6192571f5f3ce08825b7f6cbd172579100a5dceb24e88e9d6f7ba82acdbd8
SimHash 6a4c9811c213

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /readme.html
Disallow /license.txt
Disallow /?s=*
Allow /
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/images/*
Allow /*.js$
Allow /*.css$
Allow /ads.txt

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

similarwebbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mangatop.org/sitemap_index.xml