meta.com
robots.txt
Robots Exclusion Standard data for meta.com
Resource Scan
Scan Details
Site Domain | meta.com |
Base Domain | meta.com |
Scan Status | Ok |
Last Scan | 2024-05-21T03:03:06+00:00 |
Next Scan | 2024-06-20T03:03:06+00:00 |
Last Scan
Scanned | 2024-05-21T03:03:06+00:00 |
URL | https://meta.com/robots.txt |
Redirect | https://www.meta.com/robots.txt |
Redirect Domain | www.meta.com |
Redirect Base | meta.com |
Domain IPs | 157.240.235.15, 2a03:2880:f00c:100:face:b00c:0:2 |
Redirect IPs | 157.240.7.20, 2a03:2880:f00c:13:face:b00c:0:2 |
Response IP | 157.240.15.1 |
Found | Yes |
Hash | 8a8aac3e68312631e50f8a9027b06b5e2cebcdba8342d0bda325a42327a4c7ea |
SimHash | 12b26a528b92 |
Groups
*
Rule | Path |
---|---|
Allow | /*help/support/$ |
Allow | /*account/$ |
Allow | /*order/find/$ |
Allow | /*return/find/$ |
Disallow | *?_ga= |
Disallow | /*help_app/* |
Disallow | /*help/support/* |
Disallow | /*account/* |
Disallow | /order/* |
Disallow | /*help/search/* |
Disallow | /*rma/* |
Disallow | /return/* |
Disallow | /meta-employee-store/ |
Disallow | /bv/upload/* |
Disallow | /campaign/* |
Disallow | /intern/* |
Disallow | /internal/* |
Disallow | *utm_source |
Disallow | *utm_content |
Disallow | *utm_campaign |
Disallow | *utm_offering |
Disallow | *utm_product |
Disallow | *utm_medium |
Disallow | *?fb_comment_id= |
Disallow | *?id= |
Disallow | *?cursor= |
Disallow | *?ref= |
Disallow | *?intern_source |
Disallow | *?intern_content |
Disallow | */?uid |
Other Records
Field | Value |
---|---|
sitemap | https://www.meta.com/sitemap.xml |
sitemap | https://www.meta.com/help/sitemap.xml |
sitemap | https://www.meta.com/blog/quest/sitemap.xml |
sitemap | https://www.meta.com/experiences/sitemap.xml |