webask.io
robots.txt

Robots Exclusion Standard data for webask.io

Resource Scan

Scan Details

Site Domain webask.io
Base Domain webask.io
Scan Status Ok
Last Scan2024-05-08T05:49:40+00:00
Next Scan 2024-06-07T05:49:40+00:00

Last Scan

Scanned2024-05-08T05:49:40+00:00
URL https://webask.io/robots.txt
Domain IPs 104.26.12.25, 104.26.13.25, 172.67.75.68, 2606:4700:20::681a:c19, 2606:4700:20::681a:d19, 2606:4700:20::ac43:4b44
Response IP 104.26.13.25
Found Yes
Hash 4e0aebf5cb1ed046b0de58ab51435b2700d52b17c01c947268c3fbabc20795a3
SimHash 9055ae606bb2

Groups

mj12bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /*?*unsubscribe=
Disallow /*?*resubscribe=
Disallow /*?*verified_email=
Disallow /*?*utm_source=
Disallow /*?*utm_medium=
Disallow /*?*utm_term=
Disallow /*?*utm_campaign=
Disallow /*0-0-
Disallow /agreement
Disallow /bonus
Disallow /reviews
Disallow /static/*

Warnings

  • `host` is not a known field.