Log In Sign Up

picardit.fi
robots.txt

Robots Exclusion Standard data for picardit.fi

Resource Scan

Scan Details

Site Domain picardit.fi
Base Domain picardit.fi
Scan Status Ok
Last Scan2024-05-26T11:46:44+00:00
Next Scan 2024-06-02T11:46:44+00:00

Last Scan

Scanned2024-05-26T11:46:44+00:00
URL https://picardit.fi/robots.txt
Domain IPs 104.21.45.38, 172.67.208.197, 2606:4700:3032::6815:2d26, 2606:4700:3032::ac43:d0c5
Response IP 172.67.208.197
Found Yes
Hash 3f5deca245868c2e6f0a6452c7bc20c7189b71cc7941e17b66b43b5326b56ac7
SimHash 6d30187060b3

Groups

*

Rule Path
Disallow /review/
Disallow /update/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://picardIt.fi/map.xml
Back to top

Comments

  • www.robotstxt.org/
  • Allow crawling of all content
Back to top