perito.media
robots.txt

Robots Exclusion Standard data for perito.media

Resource Scan

Scan Details

Site Domain perito.media
Base Domain perito.media
Scan Status Ok
Last Scan2024-09-20T14:21:23+00:00
Next Scan 2024-10-20T14:21:23+00:00

Last Scan

Scanned2024-09-20T14:21:23+00:00
URL https://perito.media/robots.txt
Domain IPs 104.21.10.103, 172.67.131.79, 2606:4700:3032::ac43:834f, 2606:4700:3037::6815:a67
Response IP 172.67.131.79
Found Yes
Hash 8777b67851dac62575ce50a39b3e281e21f74b2664b5d8915b2783661ca4b759
SimHash 49548d50d311

Groups

yandexnews

Rule Path
Allow /feed/yandex_news.rss

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://perito.media/sitemaps/sitemap.xml.gz