devilhunter.net
robots.txt

Robots Exclusion Standard data for devilhunter.net

Resource Scan

Scan Details

Site Domain devilhunter.net
Base Domain devilhunter.net
Scan Status Ok
Last Scan2024-11-02T01:20:01+00:00
Next Scan 2024-11-09T01:20:01+00:00

Last Scan

Scanned2024-11-02T01:20:01+00:00
URL https://devilhunter.net/robots.txt
Redirect https://www.devilhunter.net/robots.txt
Redirect Domain www.devilhunter.net
Redirect Base devilhunter.net
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 172.253.118.121, 2404:6800:4003:c01::79
Response IP 142.251.12.121
Found Yes
Hash 086770fc2c6bd38696c3080a5920f7ad30f073b6f04319080f98b014b7569e5e
SimHash 28501d42cc83

Groups

*

Rule Path
Allow /
Disallow /search
Disallow /search/
Disallow /feeds
Disallow /feeds/
Disallow /p/emoji-supported-by-maximum-platforms.html
Disallow /p/emoji.html
Disallow /p/emoticons-library.html
Disallow /p/wave-library.html

Other Records

Field Value
sitemap https://www.devilhunter.net/sitemap.xml
sitemap https://www.devilhunter.net/sitemap-pages.xml