littlebirdie.com.au
robots.txt

Robots Exclusion Standard data for littlebirdie.com.au

Resource Scan

Scan Details

Site Domain littlebirdie.com.au
Base Domain littlebirdie.com.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-03T23:36:05+00:00
Next Scan 2024-10-03T23:36:05+00:00

Last Successful Scan

Scanned2024-07-29T23:34:53+00:00
URL https://www.littlebirdie.com.au/robots.txt
Domain IPs 13.33.30.49, 13.33.30.57, 13.33.30.78, 13.33.30.98
Response IP 13.33.30.78
Found Yes
Hash fa5554ee319e67e583471f78c0e49d267c19e5a3a8595125a38ab1176fb053b0
SimHash 6c13f212fe02

Groups

*

Rule Path
Disallow /
Disallow /login
Disallow /logout
Disallow /search/
Disallow /spotter/*/account
Disallow /spotter/*/my-calendar
Disallow /spotter/*/email
Disallow /spotter/*/public-profile-settings
Disallow /spotter/*/following
Disallow /goto/
Disallow /assets/
Disallow /images/
Disallow /api/

Comments

  • https://www.robotstxt.org/robotstxt.html