lepetitmarseillais.com
robots.txt
Robots Exclusion Standard data for lepetitmarseillais.com
Resource Scan
Scan Details
Site Domain | lepetitmarseillais.com |
Base Domain | lepetitmarseillais.com |
Scan Status | Ok |
Last Scan | 2024-11-16T07:28:07+00:00 |
Next Scan | 2024-11-23T07:28:07+00:00 |
Last Scan
Scanned | 2024-11-16T07:28:07+00:00 |
URL | https://www.lepetitmarseillais.com/robots.txt |
Domain IPs | 23.215.7.22, 23.215.7.7, 2600:1413:b000:1b::17d7:707, 2600:1413:b000:1b::17d7:716 |
Response IP | 23.215.7.22 |
Found | Yes |
Hash | e83576924c5f7b13b3509ca3d850cf915ca408fc31ef2485a809b41d621f2abf |
SimHash | 0914de124713 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*?bvstate |
Disallow | /*?bvroute |
Disallow | /where-to-buy/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.lepetitmarseillais.com/sitemap.xml |