famousbirthdays.com
robots.txt
Robots Exclusion Standard data for famousbirthdays.com
Resource Scan
Scan Details
Site Domain | famousbirthdays.com |
Base Domain | famousbirthdays.com |
Scan Status | Ok |
Last Scan | 2024-06-26T01:14:23+00:00 |
Next Scan | 2024-07-03T01:14:23+00:00 |
Last Scan
Scanned | 2024-06-26T01:14:23+00:00 |
URL | https://famousbirthdays.com/robots.txt |
Redirect | https://www.famousbirthdays.com/robots.txt |
Redirect Domain | www.famousbirthdays.com |
Redirect Base | famousbirthdays.com |
Domain IPs | 104.16.85.60, 104.16.86.60 |
Redirect IPs | 104.16.85.60, 104.16.86.60 |
Response IP | 104.16.85.60 |
Found | Yes |
Hash | 6f3551c88a1e487f39b1c5112bb916c33065c09b2b2875e84d16aacb0c06f701 |
SimHash | 65262404dd82 |
Groups
*
Rule | Path |
---|---|
Disallow | /people/edits |
Disallow | /groups/edits |
Disallow | /api/ |
Disallow | /app/ |
Disallow | /search |
Disallow | /random |
Disallow | /random-group/ |
Disallow | /people/%40 |
Disallow | /pending/ |
Disallow | /people/user1 |
Disallow | /people/user2 |
Disallow | /people/user3 |
Disallow | /people/user4 |
Disallow | /people/user5 |
Disallow | /people/user6 |
Disallow | /people/user7 |
Disallow | /people/user8 |
Disallow | /people/user9 |
Disallow | /contact/submit |
Disallow | /20602751/ |
Disallow | /doubleclick/ |
Disallow | /thumbnails/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.famousbirthdays.com/fb-sitemap.xml |