techminis.com
robots.txt

Robots Exclusion Standard data for techminis.com

Resource Scan

Scan Details

Site Domain techminis.com
Base Domain techminis.com
Scan Status Ok
Last Scan2024-09-22T07:27:23+00:00
Next Scan 2024-09-29T07:27:23+00:00

Last Scan

Scanned2024-09-22T07:27:23+00:00
URL https://techminis.com/robots.txt
Domain IPs 104.21.90.60, 172.67.196.12, 2606:4700:3034::ac43:c40c, 2606:4700:3035::6815:5a3c
Response IP 104.21.90.60
Found Yes
Hash a4d8e8b01b217b24757872f62add18492f0ee401cacaca73807682e7780156e3
SimHash 0c05c5c34bb0

Groups

*

Rule Path
Disallow /*?articleIds=*
Disallow /*?app=*
Disallow /api/*
Disallow /my-feeds
Disallow /naukri
Disallow /cdn-cgi/*
Disallow /privacy.html
Disallow /articles*

Comments

  • Allow all crawlers