Search Syntax

Terms

nytimes.com aol.com

Search by domain, resource type, or resource-specific fields. When there are multiple terms only one needs to match.

Phrases

"display video"

Surround terms in quotes to search for a phrase.

Require and Exclude

nytimes.com aol.com +ads_txt

Add + before a term or phrase to require it, or - to exclude it.

Prefix

nyt*

Add * after a term or phrase to search by prefix.

Filters

resource:ads_txt nytimes.com

Filters restrict results based on specific fields. They are written in the form [filter]:[value].

Most filters accept terms or phrases as values (including support for prefixes). Providing only * as a value will match resources where the relevant field exists, regardless of its value.

Some filters can only check if a field exists, so only work with * value. Others filter on boolean fields, so only work with true or false.

Exclude

-resource:ads_txt nytimes.com

Filters act as required terms by default, but can be excluded instead by adding - before the filter.

Multiple Options

resource:(ads_txt app_ads_txt) nytimes.com

Wrap terms or phrases in parenthesis to supply multiple options to a filter. Only one option needs to match.

Integer Filters

rank:<10 resource:ads_txt

Integer filters accept whole numbers.

Prefix the number with <, <=, >, or >= to filter by range.

Date Filters

scanned:>=2021-06-01 nytimes.com

Date filters accept RFC3339 formated dates in UTC.

Prefix the date with <, <=, >, or >= to filter by range.

Global Filters

status:[ok|failed]
Filter by resource scan status.

scanned:[date]
Filter by resource scan date.

domain:[value]
Filter by domain name.

resource:[value]
Filter by resource type.

scheme:[https|http]
Filter by the scheme the resource was found under.

is_www:[true|false]
Filter by whether the resource was found on the www subdomain.

base_domain:[value]
Filter by base domain (eTLD+1).

is_base_domain:[true|false]
Filter by whether the domain is the base domain.
The www subdomain is considered the base domain.

rank:[integer]
Filter by Tranco list rank of the base domain.
The top 100,000 domains are ranked.

etld:[value]
Filter by effective top-level domain (eTLD).

redir_domain:[value]
Filter by final redirect domain name, if any.

redir_base_domain:[value]
Filter by final redirect base domain (eTLD+1), if any.

redir_etld:[value]
Filter by final redirect effective top-level domain (eTLD), if any.

hash:[value]
Filter by resource sha256 hex digest.

simhash:[value]
Filter by resource simhash.

simhash_near:[value]
Filter by resource simhash, allowing similar simhashes.
Only works with full simhashes, not prefixes.

Back to top

Supported Resources

The following types of /.well-known/ resources are currently supported. Each has an associated set of search filters.

Authorized Digital Sellers

/ads.txt (spec)

Defined by the IAB Tech Lab, ads.txt allows sites to specify which ad system accounts are authorised to sell their ad inventory.

Resource Filter

resource:ads_txt
Filter to only ads.txt resources.

Variable Filters

Filter by the variables included in ads.txt resources.

ads_contact:[value]
Filter by the contact variable.

ads_subdomain:[value]
Filter by the subdomain variable.

ads_partner:[value]
Filter by the inventory partner domain variable.

Record Filters

Filter by the ad account records listed in ads.txt resources.

ads_system:[value]
Filter by ad system domain.

ads_seller:[value]
Filter by seller ID.

ads_account:[value]
Filter by the full account ID, in the form [ad system]|[seller id].

ads_direct:[value]
Same as ads_account, but only match accounts listed in DIRECT records.

ads_reseller:[value]
Same as ads_account, but only match accounts listed in RESELLER records.

ads_cid:[value]
Filter by certification authority ID.

ads_extension:[value]
Filter by record extension data.

ads_inline_comment:[value]
Filter by comments at the end of record lines.

ads_placeholder:[true|false]
Filter by placeholder record presence.

ads_comment:[value]
Filter by standalone comments.

Back to top

Authorized Digital Sellers for Apps

/app-ads.txt (spec)

Defined by the IAB Tech Lab, app-ads.txt allows apps to specify which ad system accounts are authorised to sell their ad inventory.

Resource Filter

resource:app_ads_txt
Filter to only app-ads.txt resources.

Variable Filters

Filter by the variables included in app-ads.txt resources.

aads_contact:[value]
Filter by the contact variable.

aads_partner:[value]
Filter by the inventory partner domain variable.

Record Filters

Filter by the ad account records listed in app-ads.txt resources.

aads_system:[value]
Filter by ad system domain.

aads_seller:[value]
Filter by seller ID.

aads_account:[value]
Filter by the full account ID, in the form [ad system]|[seller id].

aads_direct:[value]
Same as aads_account, but only match accounts listed in DIRECT records.

aads_reseller:[value]
Same as aads_account, but only match accounts listed in RESELLER records.

aads_cid:[value]
Filter by certification authority ID.

aads_extension:[value]
Filter by record extension data.

aads_inline_comment:[value]
Filter by comments at the end of record lines.

aads_placeholder:[true|false]
Filter by placeholder record presence.

aads_comment:[value]
Filter by standalone comments.

Back to top

Apple Associated Domain

/.well-known/apple-app-site-association (spec)

An Apple specification that allows a site to define its relationship to Apple platform apps, e.g. allow links to a site to be opened in an app instead.

Resource Filter

resource:apple_app_site_association
Filter to only apple-app-site-association resources.

Web Credential Filters

Filter by the webcredential data in apple-app-site-association resources.

asa_webcredential_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id].

asa_webcredential_app_prefix:[value]
Filter by app ID prefix.

asa_webcredential_bundle:[value]
Filter by bundle ID.

App Clip Filters

Filter by the appclip data in apple-app-site-association resources.

asa_appclip_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id].

asa_appclip_app_prefix:[value]
Filter by app ID prefix.

asa_appclip_bundle:[value]
Filter by bundle ID.

App Link Filters

Filter by the applink data in apple-app-site-association resources.

asa_applink_default:*
Filter by whether any domain-level defaults are set.

asa_applink_substitution:*
Filter by whether any substitution variables are defined.

asa_applink_app:[value]
Filter by app ID, in the form [app id prefix].[bundle id].

asa_applink_app_prefix:[value]
Filter by app ID prefix.

asa_applink_bundle:[value]
Filter by bundle ID.

asa_applink_app_default:*
Filter by whether any app-level defaults are set.

asa_applink_path:*
Filter by whether components define a path pattern.

asa_applink_query:*
Filter by whether components define a query pattern.

asa_applink_fragment:*
Filter by whether components define a fragment pattern.

asa_applink_exclude:[true|false]
Filter by component exclude value.

asa_applink_case_sensitive:[true|false]
Filter by component case sensitive value.

asa_applink_percent_encoded:[true|false]
Filter by component percent encoded value.

asa_applink_comment:[value]
Filter by component comment.

Back to top

Filters

Filter by the asset links listed in assetlinks.json resources.

dal_relation:[value]
Filter by link relation type.

dal_target_namespace:[value]
Filter by link target namespace.
Namespaces: web, android_app, ios_app

dal_target_package:[value]
Filter by link target android package name, for andoid_app links.

dal_target_appid:[value]
Filter by link target iOS app ID, for ios_app links.

dal_include:*
Filter by whether any external assetlink.json resources are included.

Back to top

Global Privacy Control

/.well-known/gpc.json (spec)

The Global Privacy Control is a signal user agents can send to sites, requesting that their personal information is not sold or shared with third parties. The gpc.json resource allows sites to indicate whether they respect the Global Privacy Control signal.

Resource Filter

resource:gpc
Filter to only gpc.json resources.

Filters

Filter by the asset links listed in gpc.json resources.

gpc_support:[true|false]
Filter by whether GPC is supported.

gpc_update:*
Filter by whether a last update date/time is provided.

Back to top

OpenID Provider Configuration

/.well-known/openid-configuration (spec)

An OpenID Provider Configuration resource includes metadata about an OpenID Connect provider, allowing clients to configure themselves to use the provider.

Resource Filter

resource:openid_configuration
Filter to only openid-configuration resources.

Exists Filters

oid_authorization_endpoint:*
Filter by whether an authorization endpoint is provided.

oid_token_endpoint:*
Filter by whether a token endpoint is provided.

oid_userinfo_endpoint:*
Filter by whether a userinfo endpoint is provided.

oid_jwks_uri:*
Filter by whether a JSON Web Key Set URI is provided.

oid_registration_endpoint:*
Filter by whether a registration endpoint is provided.

oid_service_documentation:*
Filter by whether a service documentation URI is provided.

oid_policy_uri:*
Filter by whether a data policy URI is provided.

oid_tos_uri:*
Filter by whether a terms of service URI is provided.

Boolean Filters

oid_claims_parameter:[true|false]
Filter by whether the claims parameter is supported.

oid_request_parameter:[true|false]
Filter by whether the request parameter is supported.

oid_request_uri_parameter:[true|false]
Filter by whether the request_uri parameter is supported.

oid_require_request_uri_registration:[true|false]
Filter by whether request_uri parameter values must be pre-registered.

Text Filters

oid_scope:[value]
Filter by supported scopes.

oid_response_type:[value]
Filter by supported response types.

oid_response_mode:[value]
Filter by supported response modes.

oid_grant_type:[value]
Filter by supported grant types.

oid_acr:[value]
Filter by supported Authentication Context Class References.

oid_subject_type:[value]
Filter by supported subject types.

oid_display:[value]
Filter by supported display parameter values.

oid_claim_type:[value]
Filter by supported claim types.

oid_claim:[value]
Filter by supported claims.

oid_claims_locale:[value]
Filter by supported languages for claim values.

oid_ui_locale:[value]
Filter by supported languages for the user interface.

oid_id_token_signing_alg:[value]
Filter by supported token signing algorithms.

oid_id_token_encryption_alg:[value]
Filter by supported token encryption algorithms (alg values).

oid_id_token_encryption_enc:[value]
Filter by supported token encryption algorithms (enc values).

oid_id_userinfo_signing_alg:[value]
Filter by supported userinfo signing algorithms.

oid_id_userinfo_encryption_alg:[value]
Filter by supported userinfo encryption algorithms (alg values).

oid_id_userinfo_encryption_enc:[value]
Filter by supported userinfo encryption algorithms (enc values).

oid_id_request_object_signing_alg:[value]
Filter by supported request object signing algorithms.

oid_id_request_object_encryption_alg:[value]
Filter by supported request object encryption algorithms (alg values).

oid_id_request_object_encryption_enc:[value]
Filter by supported request object encryption algorithms (enc values).

oid_token_endpoint_auth_method:[value]
Filter by supported token endpoint authentication methods.

oid_token_endpoint_auth_signing_alg:[value]
Filter by supported token endpoint authentication signing algorithms.

Back to top

Robots Exclusion Standard

/robots.txt (spec)

An informal standard that allows sites to ask web crawlers to not crawl certain urls.

Resource Filter

resource:robots_txt
Filter to only robots.txt resources.

Filters

rbt_product:[value]
Filter by robot product tokens (User-Agent values).

rbt_product_comment:[value]
Filter by comments at the end of User-Agent lines.

rbt_rule_pattern:[value]
Filter by path patterns (Allow/Disallow values).

rbt_rule_comment:[value]
Filter by comments at the end of Allow/Disallow lines.

rbt_allow_rule:[value]
Filter by Allow rules, in the form [product token]|[path pattern].

rbt_disallow_rule:[value]
Filter by Disallow rules, in the form [product token]|[path pattern].

rbt_crawldelay:*
Filter by whether any Crawl-delay lines are present.

rbt_crawldelay_comment:[value]
Filter by comments at the end of Crawl-delay lines.

rbt_sitemap:*
Filter by whether any Sitemap lines are present.

rbt_sitemap_comment:[value]
Filter by comments at the end of Sitemap lines.

rbt_comment:[value]
Filter by standalone comments.

Back to top

security.txt

/.well-known/security.txt (spec)

Allows sites to communicate their security policies, e.g. how to report a vulnerability.

Resource Filter

resource:security_txt
Filter to only security.txt resources.

Filters

sec_signed:[true|false]
Filter by whether the security.txt resource is signed.

sec_signer:[value]
Filter by the IDs of the keys used to sign the resource.

sec_acknowledge:*
Filter by whether an acknowledgments URI is provided.

sec_canonical:*
Filter by whether a canonical URI is provided.

sec_contact:*
Filter by whether a contact URI is provided.

sec_encryption:*
Filter by whether an encryption key URI is provided.

sec_expires:*
Filter by whether an expires datetime is provided.

sec_hiring:*
Filter by whether a hiring URI is provided.

sec_policy:*
Filter by whether a disclosure policy URI is provided.

sec_policy:[value]
Filter by the preferred languages listed.

Back to top