1001pelit.com
robots.txt

Robots Exclusion Standard data for 1001pelit.com

Resource Scan

Scan Details

Site Domain 1001pelit.com
Base Domain 1001pelit.com
Scan Status Ok
Last Scan2024-05-19T12:14:30+00:00
Next Scan 2024-05-26T12:14:30+00:00

Last Scan

Scanned2024-05-19T12:14:30+00:00
URL https://1001pelit.com/robots.txt
Redirect https://www.1001pelit.com/robots.txt
Redirect Domain www.1001pelit.com
Redirect Base 1001pelit.com
Domain IPs 104.26.6.148, 104.26.7.148, 172.67.69.4, 2606:4700:20::681a:694, 2606:4700:20::681a:794, 2606:4700:20::ac43:4504
Redirect IPs 104.26.6.148, 104.26.7.148, 172.67.69.4, 2606:4700:20::681a:694, 2606:4700:20::681a:794, 2606:4700:20::ac43:4504
Response IP 172.67.69.4
Found Yes
Hash 83914e3dad304e0280fdf8ab1ce0318a2cf6b34d6c96cb3d1f9b58ca945eb2c9
SimHash 69044c00cd93

Groups

*

Rule Path
Disallow /m/
Disallow /mobile/
Disallow /lib/

Other Records

Field Value
sitemap https://www.1001pelit.com/sitemap.xml