byliner.com
robots.txt
Robots Exclusion Standard data for byliner.com
Resource Scan
Scan Details
| Site Domain | byliner.com |
| Base Domain | byliner.com |
| Scan Status | Ok |
| Last Scan | 2025-04-26T10:42:24+00:00 |
| Next Scan | 2025-05-10T10:42:24+00:00 |
Last Scan
| Scanned | 2025-04-26T10:42:24+00:00 |
| URL | https://byliner.com/robots.txt |
| Domain IPs | 104.21.8.181, 172.67.157.163, 2606:4700:3030::6815:8b5, 2606:4700:3032::ac43:9da3 |
| Response IP | 172.67.157.163 |
| Found | Yes |
| Hash | 81280bd75407abb4456d9cb026f6c0f4fff091e6e9026c76c44f11a97dc25c4b |
| SimHash | 684d59c6c89a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /out/ |
| Disallow | /go/ |
| Disallow | /outtax/ |
| Disallow | /*? |
| Disallow | /*/*? |
| Disallow | /*/?wpcd_coupon |
| Disallow | /*?fb_comment_id=* |
| Disallow | /rss* |
| Disallow | /feed/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-login.php |
| Disallow | /signatures/ |
| Disallow | /feed |
| Disallow | /comments/feed |
| Disallow | /wp-comments-post.php |
| Disallow | /feed/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /feed/rss2/ |
| Disallow | /*/feed/rss2/ |
| Disallow | /*/*/feed/rss2/ |
| Disallow | /*/*/*/feed/rss2/ |
| Disallow | /xmlrpc.php |
| Disallow | /cgi-bin/ |
| Disallow | /license.txt |
| Disallow | /landing/ |
adsbot-google
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /out/ |
| Disallow | /go/ |
| Disallow | /outtax/ |
| Disallow | /*? |
| Disallow | /*/*? |
| Disallow | /*/?wpcd_coupon |
| Disallow | /*?fb_comment_id=* |
| Disallow | /rss* |
| Disallow | /feed/ |
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /wp-login.php |
| Disallow | /signatures/ |
| Disallow | /feed |
| Disallow | /comments/feed |
| Disallow | /wp-comments-post.php |
| Disallow | /feed/$ |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /feed/rss2/ |
| Disallow | /*/feed/rss2/ |
| Disallow | /*/*/feed/rss2/ |
| Disallow | /*/*/*/feed/rss2/ |
| Disallow | /xmlrpc.php |
| Disallow | /cgi-bin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://byliner.com/sitemap_index.xml |
Warnings
- 2 invalid lines.