sg.petalsearch.com
robots.txt
Robots Exclusion Standard data for sg.petalsearch.com
Resource Scan
Scan Details
| Site Domain | sg.petalsearch.com |
| Base Domain | petalsearch.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-23T21:05:09+00:00 |
| Next Scan | 2024-07-22T21:05:09+00:00 |
Last Successful Scan
| Scanned | 2023-06-22T21:02:45+00:00 |
| URL | https://sg.petalsearch.com/robots.txt |
| Domain IPs | 18.155.68.123, 18.155.68.53, 18.155.68.62, 18.155.68.78, 2600:9000:23d2:2c00:8:559a:9400:93a1, 2600:9000:23d2:2e00:8:559a:9400:93a1, 2600:9000:23d2:3000:8:559a:9400:93a1, 2600:9000:23d2:5800:8:559a:9400:93a1, 2600:9000:23d2:d600:8:559a:9400:93a1, 2600:9000:23d2:de00:8:559a:9400:93a1, 2600:9000:23d2:ea00:8:559a:9400:93a1, 2600:9000:23d2:f000:8:559a:9400:93a1 |
| Response IP | 18.161.97.3 |
| Found | Yes |
| Hash | ae495b314f5ea6a95531ccf2d0feb6e2685f5e8831cb095c15272fb1e62ad49e |
| SimHash | 580bcc7f4cd7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /p |
| Disallow | /render_server |
| Disallow | /service |
| Disallow | /render2 |
| Disallow | /usercenter |
| Disallow | /intervene |
| Disallow | /sparkle_aggregator/ |
| Disallow | /sead/api |
| Disallow | /voicesearch |
| Disallow | /assistant |
| Disallow | /api |
| Disallow | /search/api/ |
| Disallow | /getNewList |
| Disallow | /huawei_search_unshelve |
| Disallow | /newsfeed/ |
| Disallow | /activity/ |
| Disallow | /feed |
| Disallow | /user |
| Allow | /cch5 |
| Allow | /home |
| Allow | /p/shopping |
| Disallow | /p/shopping/ali |
| Disallow | /p/shopping/detail |
| Disallow | /p/shopping/similar |
| Allow | /p/image |
| Disallow | /p/image/detail |
| Allow | /p/travel |
| Allow | /p/sports |
| Allow | /app/home |
| Allow | /p/nearby/home |