meridianservices.com.au
robots.txt

Robots Exclusion Standard data for meridianservices.com.au

Resource Scan

Scan Details

Site Domain meridianservices.com.au
Base Domain meridianservices.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-28T19:16:16+00:00
Next Scan 2024-10-26T19:16:16+00:00

Last Successful Scan

Scanned2024-01-01T19:14:24+00:00
URL https://meridianservices.com.au/robots.txt
Domain IPs 104.21.93.190, 172.67.214.4, 2606:4700:3030::6815:5dbe, 2606:4700:3034::ac43:d604
Response IP 104.21.93.190
Found Yes
Hash 422fcc8c8f39231338ece1c66fa72f942d4c1b32969e4a8c68448e67aa5273e3
SimHash 6910187160b7

Groups

*

Rule Path
Disallow /review/
Disallow /update/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingpreview

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://meridianservices.com.au/map.xml

Comments

  • www.robotstxt.org/
  • Allow crawling of all content