community.24baby.nl
robots.txt
Robots Exclusion Standard data for community.24baby.nl
Resource Scan
Scan Details
Site Domain | community.24baby.nl |
Base Domain | 24baby.nl |
Scan Status | Ok |
Last Scan | 2024-06-13T08:39:34+00:00 |
Next Scan | 2024-06-27T08:39:34+00:00 |
Last Scan
Scanned | 2024-06-13T08:39:34+00:00 |
URL | https://community.24baby.nl/robots.txt |
Domain IPs | 52.212.52.84, 54.247.69.169, 63.32.161.232 |
Response IP | 63.32.161.232 |
Found | Yes |
Hash | 436270fa02e226990f630702fc56116680e218aab13e996684f9283329f969c3 |
SimHash | a80c91828be3 |
Groups
*
Rule | Path |
---|---|
Disallow | /leden/* |
*
Rule | Path |
---|---|
Disallow | /mitglieder/* |
*
Rule | Path |
---|---|
Disallow | /groepen/*/leden/ |
*
Rule | Path |
---|---|
Disallow | /gruppen/*/gruppen/ |
*
Rule | Path |
---|---|
Disallow | /forum/*/likes/ |
*
Rule | Path |
---|---|
Disallow | /en/* |
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://24baby-production.s3-eu-west-1.amazonaws.com/sitemaps/sitemapindex-community.24baby.nl.xml |