taskoprupostasi.com
robots.txt

Robots Exclusion Standard data for taskoprupostasi.com

Resource Scan

Scan Details

Site Domain taskoprupostasi.com
Base Domain taskoprupostasi.com
Scan Status Ok
Last Scan2025-09-30T12:29:07+00:00
Next Scan 2025-10-07T12:29:07+00:00

Last Scan

Scanned2025-09-30T12:29:07+00:00
URL https://taskoprupostasi.com/robots.txt
Redirect https://www.taskoprupostasi.com/robots.txt
Redirect Domain www.taskoprupostasi.com
Redirect Base taskoprupostasi.com
Domain IPs 104.21.24.172, 172.67.219.196, 2606:4700:3034::6815:18ac, 2606:4700:3035::ac43:dbc4
Redirect IPs 104.21.24.172, 172.67.219.196, 2606:4700:3034::6815:18ac, 2606:4700:3035::ac43:dbc4
Response IP 104.21.24.172
Found Yes
Hash e6a2099fc74a217a98f000446629b8ca9511bfea8650571ff42f0e93b9b199a4
SimHash 08001ee2c212

Groups

*

Rule Path
Disallow /public
Disallow /public/*
Disallow /service*
Disallow /arama/
Disallow /api
Disallow /*?q=
Disallow /*?preview=
Disallow /*?utm_source=
Disallow /*?page=
Disallow /*%26page%3D
Disallow /*?sort=
Disallow /*%26sort%3D
Disallow /service/
Disallow /advert/*
Disallow /*model%3DTE%5C
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /user/
Disallow /auth/
Disallow */bigdata/hit.json

adsbot-google

Rule Path
Disallow /advert/*
Allow /

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Allow /

semrushbot

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

applebot

Rule Path
Disallow /vendor/
Disallow /media/
Disallow /public/
Disallow /admin/
Disallow /login/
Disallow /register/
Disallow /password-reset/
Disallow /user/
Disallow /auth/

Other Records

Field Value
sitemap https://www.taskoprupostasi.com/sitemap.xml
sitemap https://www.taskoprupostasi.com/rss?yandex=turbo

Warnings

  • `clean-param` is not a known field.