ilsipontino.net
robots.txt

Robots Exclusion Standard data for ilsipontino.net

Resource Scan

Scan Details

Site Domain ilsipontino.net
Base Domain ilsipontino.net
Scan Status Ok
Last Scan2024-06-24T22:29:25+00:00
Next Scan 2024-07-01T22:29:25+00:00

Last Scan

Scanned2024-06-24T22:29:25+00:00
URL https://ilsipontino.net/robots.txt
Redirect https://www.ilsipontino.net/robots.txt
Redirect Domain www.ilsipontino.net
Redirect Base ilsipontino.net
Domain IPs 93.186.242.33
Redirect IPs 93.186.242.33
Response IP 93.186.242.33
Found Yes
Hash 8e229b47af9023b895b98e7e1e8122c1265321dfe23ca76512b5de4fc1332ede
SimHash 364158d481b3

Groups

*

Rule Path
Disallow /app-ilsipontino
Disallow *%26s%3D
Disallow /cgi-bin

moget
ichiro

Rule Path
Disallow /

naverbot
yeti

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ilsipontino.net/sitemap_index.xml
sitemap https://www.ilsipontino.net/news-sitemap.xml

Warnings

  • 6 invalid lines.
  • `disaalow` is not a known field.