ar.pngtree.com
robots.txt
Robots Exclusion Standard data for ar.pngtree.com
Resource Scan
Scan Details
| Site Domain | ar.pngtree.com |
| Base Domain | pngtree.com |
| Scan Status | Ok |
| Last Scan | 2025-02-23T09:11:25+00:00 |
| Next Scan | 2025-03-25T09:11:25+00:00 |
Last Scan
| Scanned | 2025-02-23T09:11:25+00:00 |
| URL | https://ar.pngtree.com/robots.txt |
| Domain IPs | 104.18.2.157, 104.18.3.157, 2606:4700::6812:29d, 2606:4700::6812:39d |
| Response IP | 104.18.3.157 |
| Found | Yes |
| Hash | a40d98b52d124570ff801103d063b05d635cfbacf0dcbd1ab95f3a86f1c71284 |
| SimHash | 64154050dd74 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /element/down?* |
| Disallow | /back/down?* |
| Disallow | /photos/down?* |
| Disallow | /template/down?* |
| Disallow | /iconfont/down?* |
| Disallow | /ppt/down?* |
| Disallow | /api/* |
| Disallow | /*/*porn* |
| Disallow | /*/*fuck* |
| Disallow | /free-icon*/ |
| Disallow | /element/vrf_down?* |
| Disallow | /freepng/*/preview-png.html |
| Disallow | /freepng/*.html*hue-js |
| Disallow | /help-centers/* |
| Disallow | /cdn-cgi/* |
| Disallow | /apiv4* |
| Disallow | /similar-png/* |
| Disallow | /slide/* |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /element/down?* |
| Disallow | /back/down?* |
| Disallow | /photos/down?* |
| Disallow | /template/down?* |
| Disallow | /iconfont/down?* |
| Disallow | /ppt/down?* |
| Disallow | /api/* |
| Disallow | /*/*porn* |
| Disallow | /*/*fuck* |
| Disallow | /free-icon*/ |
| Disallow | /topic/*?* |
| Disallow | /freepng/*/preview-png.html |
| Disallow | /freepng/*.html*hue-js |
| Disallow | /element/vrf_down?* |
| Disallow | /freepng/*/preview-png.html |
| Disallow | /freepng/*.html*hue-js |
| Disallow | /help-centers/* |
| Disallow | /*Base_OpenWin* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 200 |
Warnings
- 10 invalid lines.
Comments