nettiaseet.fi
robots.txt

Robots Exclusion Standard data for nettiaseet.fi

Resource Scan

Scan Details

Site Domain nettiaseet.fi
Base Domain nettiaseet.fi
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T13:10:06+00:00
Next Scan 2024-12-18T13:10:06+00:00

Last Successful Scan

Scanned2024-05-23T11:10:25+00:00
URL https://nettiaseet.fi/robots.txt
Redirect https://www.nettiaseet.fi:443/robots.txt
Redirect Domain www.nettiaseet.fi
Redirect Base nettiaseet.fi
Domain IPs 34.240.134.142, 54.247.148.182
Redirect IPs 34.240.134.142, 54.247.148.182
Response IP 34.240.134.142
Found Yes
Hash ce948d57cb9d47a7f9d152eb6d2ce309f69f86451a02d59b08af9799bebe1d59
SimHash c644dcac5b10

Groups

*

Rule Path
Disallow /*sort_field%3D
Disallow /*published_at%3D
Disallow /*page%3D
Disallow /*callback%3D
Disallow /*data%3D
Disallow /*formName%3D
Disallow /*itemIdI%3D
Disallow /*keywords%3D
Disallow /*ordby%3D
Disallow /*order_list%3D
Disallow /*ordtype%3D
Disallow /*page%3D
Disallow /*purchasedPackageRuleIdI%3D
Disallow /*rows%3D
Disallow /*sort_field%3D
Disallow /*upsellId%3D
Disallow /*upsellType%3D
Disallow /*userIdI%3D
Disallow /docs
Disallow /errors
Disallow /uploads/documents
Disallow /uploads/tiny_mce_images
Disallow /uploads/tmp
Disallow /uploads/assets
Disallow /market/pdf/*
Disallow /*print$
Disallow /maintenance.html
Disallow /js/routing?*

Other Records

Field Value
crawl-delay 1

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nettiaseet.fi/sitemap.xml