girlsaskguys.com
robots.txt
Robots Exclusion Standard data for girlsaskguys.com
Resource Scan
Scan Details
| Site Domain | girlsaskguys.com |
| Base Domain | girlsaskguys.com |
| Scan Status | Ok |
| Last Scan | 2024-06-29T20:06:15+00:00 |
| Next Scan | 2024-07-06T20:06:15+00:00 |
Last Scan
| Scanned | 2024-06-29T20:06:15+00:00 |
| URL | https://girlsaskguys.com/robots.txt |
| Redirect | https://www.girlsaskguys.com/robots.txt |
| Redirect Domain | www.girlsaskguys.com |
| Redirect Base | girlsaskguys.com |
| Domain IPs | 104.26.2.103, 104.26.3.103, 172.67.71.40, 2606:4700:20::681a:267, 2606:4700:20::681a:367, 2606:4700:20::ac43:4728 |
| Redirect IPs | 104.26.2.103, 104.26.3.103, 172.67.71.40, 2606:4700:20::681a:267, 2606:4700:20::681a:367, 2606:4700:20::ac43:4728 |
| Response IP | 104.26.2.103 |
| Found | Yes |
| Hash | bb07810eba88ab1f927d785140693ce16fbecef92550008d96c7b6f18d1a74e1 |
| SimHash | 3b099e560c34 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /girlsaskguys/a* |
| Allow | /how-do-i-look/a* |
| Disallow | /show-nextquestion* |
| Disallow | /p/* |
| Disallow | /show-ad?id= |
| Disallow | /showad.html* |
| Disallow | /help/pop* |
| Disallow | /article/putthumb* |
| Disallow | /question/putthumb* |
| Disallow | /*/vote-poll |
| Disallow | /signin* |
| Disallow | /signup* |
| Disallow | /reported-posts |
| Disallow | /banner-feed* |
| Disallow | /brand-styles* |
| Disallow | /1041900/* |
| Disallow | /digits-show* |
| Disallow | /qt/* |
| Disallow | /question/* |
| Disallow | /article/* |
| Disallow | /user/* |
| Disallow | *buy-product?id=* |
| Disallow | */search?q=* |
| Disallow | /girlsaskguys/q* |
| Disallow | /girlsaskguys$ |
| Disallow | /how-do-i-look/q* |
| Disallow | /how-do-i-look$ |
| Disallow | /hub/pageviewamp |
| Disallow | /home/get-last-questions-from-users-for-user |
| Disallow | /answer-connect |
| Disallow | */lazy-module* |
| Disallow | /sc/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.girlsaskguys.com/sitemaps/sitemaps.xml |