automedia.as
robots.txt

Robots Exclusion Standard data for automedia.as

Resource Scan

Scan Details

Site Domain automedia.as
Base Domain automedia.as
Scan Status Ok
Last Scan2025-07-05T11:18:00+00:00
Next Scan 2025-08-04T11:18:00+00:00

Last Scan

Scanned2025-07-05T11:18:00+00:00
URL https://automedia.as/robots.txt
Redirect https://www.automedia.as/robots.txt
Redirect Domain www.automedia.as
Redirect Base automedia.as
Domain IPs 34.193.204.92, 34.193.69.252
Redirect IPs 13.203.125.58, 13.233.175.166, 3.109.243.18
Response IP 15.161.34.42
Found Yes
Hash 4184ca854fb904cca447a2b470f873aba88e39f499b23640fde92277ef6b70d8
SimHash 44841560049b

Groups

*

Rule Path
Disallow */firma/
Disallow */takk/privatleasing
Disallow */takk/hovedskjema
Disallow */takk-kontaktskjema
Disallow */mercedes-eqa-426-km
Disallow */mercedes-eqa-426-km-privatleasing
Disallow */mercedes-eqa-amg
Disallow */mercedes-eqa
Disallow */privatleasing-egenskaper/
Disallow */privatleasing-merker-a-m/
Disallow */privatleasing-merker-n-z/
Disallow */firmaleasing-merker-a-m/
Disallow */firmaleasing-merker-n-z/
Disallow */firmaleasing-egenskaper/
Disallow */leasing-varebil-old/
Disallow */priser/

Other Records

Field Value
sitemap https://www.automedia.as/sitemap.xml

Comments

  • https://www.automedia.as/ robots.txt -- just crawl it.