mpgdover.com
robots.txt

Robots Exclusion Standard data for mpgdover.com

Resource Scan

Scan Details

Site Domain mpgdover.com
Base Domain mpgdover.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-23T15:52:46+00:00
Next Scan 2025-04-30T15:52:46+00:00

Last Successful Scan

Scanned2025-03-23T15:52:11+00:00
URL https://mpgdover.com/robots.txt
Redirect https://www.mpgdover.com/robots.txt
Redirect Domain www.mpgdover.com
Redirect Base mpgdover.com
Domain IPs 151.101.131.10, 151.101.195.10, 151.101.3.10, 151.101.67.10
Redirect IPs 23.46.230.138, 23.46.230.158, 2600:1413:b000:13::b857:c19b, 2600:1413:b000:13::b857:c19c
Response IP 42.99.140.163
Found Yes
Hash 411655b45c72e06ef111fa7b9ca2861045010eb8757a5e7040fc290c03c20f0d
SimHash d1019196cef1

Groups

*

Rule Path
Allow /

siteimprove.com

Rule Path
Allow /

twitterbot

Rule Path
Allow /

algolia crawler

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.mpgdover.com/en/sitemap.xml

Comments

  • Algolia-Crawler-Verif: EECF9C8E1A054772AAA

Warnings

  • 9 invalid lines.