ofscienceandswords.com.au
robots.txt

Robots Exclusion Standard data for ofscienceandswords.com.au

Resource Scan

Scan Details

Site Domain ofscienceandswords.com.au
Base Domain ofscienceandswords.com.au
Scan Status Ok
Last Scan2024-05-15T00:05:24+00:00
Next Scan 2024-06-14T00:05:24+00:00

Last Scan

Scanned2024-05-15T00:05:24+00:00
URL https://ofscienceandswords.com.au/robots.txt
Domain IPs 104.26.8.56, 104.26.9.56, 172.67.68.137, 2606:4700:20::681a:838, 2606:4700:20::681a:938, 2606:4700:20::ac43:4489
Response IP 104.26.9.56
Found Yes
Hash 1f221494b8e6fda943cccfd8a2a61ce4f1c1ac975b01e7c727119714b7ef77f7
SimHash e5c85e51d8ed

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

*

Rule Path
Disallow /wishlist/changePublished/
Disallow /wishlist/detailCustomizingModal/
Disallow /wishlist/changeName/
Disallow /wishlist/getArticle/
Disallow /wishlist/public/
Disallow /wishlist/restore/
Disallow /wishlist/share/
Disallow /wishlist/wishlistConfirmModal/
Disallow /compare/
Disallow /checkout/
Disallow /register/
Disallow /account/
Disallow /address/
Disallow /note/
Disallow /widgets/
Disallow /listing/
Disallow /ticket/
Disallow /tracking/
Allow /widgets/emotion

Other Records

Field Value
sitemap https://ofscienceandswords.com.au/sitemap_index.xml