arabiaparenting.firstcry.com
robots.txt
Robots Exclusion Standard data for arabiaparenting.firstcry.com
Resource Scan
Scan Details
Site Domain | arabiaparenting.firstcry.com |
Base Domain | firstcry.com |
Scan Status | Ok |
Last Scan | 2024-09-15T13:27:36+00:00 |
Next Scan | 2024-10-15T13:27:36+00:00 |
Last Scan
Scanned | 2024-09-15T13:27:36+00:00 |
URL | https://arabiaparenting.firstcry.com/robots.txt |
Domain IPs | 23.215.7.12, 23.215.7.15, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:70f |
Response IP | 23.52.40.42 |
Found | Yes |
Hash | 0292512d48b5b809535a834c5a4fa91d16b1990a6c5c16e928568527aabd6d3d |
SimHash | 42a5ca2472b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-admin/admin-ajax.php |
Disallow | /articles/author/ |
Disallow | /shopping/ |
Disallow | /ssc/ |
Disallow | /dwqa-questions/ |
Disallow | /page_id* |
Disallow | */feed/* |
Disallow | /home-2/ |