urbanfonts.com
robots.txt
Robots Exclusion Standard data for urbanfonts.com
Resource Scan
Scan Details
| Site Domain | urbanfonts.com |
| Base Domain | urbanfonts.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T13:35:58+00:00 |
| Next Scan | 2024-11-20T13:35:58+00:00 |
Last Scan
| Scanned | 2024-11-13T13:35:58+00:00 |
| URL | https://urbanfonts.com/robots.txt |
| Redirect | https://www.urbanfonts.com/robots.txt |
| Redirect Domain | www.urbanfonts.com |
| Redirect Base | urbanfonts.com |
| Domain IPs | 104.26.14.140, 104.26.15.140, 172.67.74.94, 2606:4700:20::681a:e8c, 2606:4700:20::681a:f8c, 2606:4700:20::ac43:4a5e |
| Redirect IPs | 104.26.14.140, 104.26.15.140, 172.67.74.94, 2606:4700:20::681a:e8c, 2606:4700:20::681a:f8c, 2606:4700:20::ac43:4a5e |
| Response IP | 172.67.74.94 |
| Found | Yes |
| Hash | 50743c1e6c078e6d477f66a3f03cce2ca5426bd4fe04973bbe41a41b7ea046fa |
| SimHash | 290067e4a593 |
Groups
yahoo! slurp
| Rule | Path |
|---|---|
| Disallow | /*.gif$ |
| Disallow | /*.png$ |
| Disallow | /*_dev.php |
| Disallow | /app |
| Disallow | /*.jpg$ |
| Disallow | /*.ttf$ |
| Disallow | /scripts/ |
| Disallow | /scripts2/ |
| Disallow | /ads/ |
| Disallow | /cache/ |
| Disallow | /fonts/images/ |
| Disallow | /forum |
| Disallow | /fonts/images2/ |
| Disallow | /fonts/commercial/images/ |
| Disallow | /fonts/commercial/images2/ |
| Disallow | /dingbats/images/ |
| Disallow | /dingbats/images2/ |
| Disallow | /images/ |
| Disallow | /images2/ |
| Disallow | /adminpanel/ |
| Disallow | /fonts/folders/ |
| Disallow | /fonts/admin_authors.php |
| Disallow | /fonts/fonts/folders/ |
| Disallow | /members.aol.com/ |
| Disallow | /javascript*/ |
| Disallow | /font.htm |
| Disallow | /download.php |
| Allow | /*?$ |
*
| Rule | Path |
|---|---|
| Disallow | /scripts/ |
| Disallow | /scripts2/ |
| Disallow | /ads/ |
| Disallow | /cgi-bin/ |
| Disallow | /tmp/ |
| Disallow | /cache/ |
| Disallow | /fonts/images/ |
| Disallow | /fonts/images2/ |
| Disallow | /fonts/commercial/images/ |
| Disallow | /fonts/commercial/images2/ |
| Disallow | /dingbats/images/ |
| Disallow | /dingbats/images2/ |
| Disallow | /images/ |
| Disallow | /images2/ |
| Disallow | /adminpanel/ |
| Disallow | /fonts/folders/ |
| Disallow | /fonts/admin_authors.php |
| Disallow | /download.php |
| Disallow | /fonts/fonts/folders/ |
| Disallow | /members.aol.com/ |
| Disallow | /javascript*/ |
| Disallow | /font.htm |
| Disallow | /forum |
| Disallow | /fonts/dingbats/ |
| Disallow | /fonts/categorized/ |