User-agent: * Allow: / # Worker endpoints, not pages. /welcome also carries a Stripe session id in # the query string. Disallow: /api/ Disallow: /auth/ Disallow: /welcome # NOTE: /signin and /subscribe are deliberately NOT disallowed. Both already # send , and a crawler has to be able to # fetch a page to see that tag — blocking them here would leave them indexed # with no way to drop out. # # /rate is the opposite case, and the difference is worth stating. It is one URL # per film in the catalog rather than one page, it is per-account and behind # sign-in — a crawler gets a 401 sign-in page and never a rating — and no URL # under it has ever been indexed, so there is nothing here that needs to be # fetched in order to drop out. The pages carry noindex as well, for anything # that arrives through the link on a film page regardless. Disallow: /rate # Same case as /rate: per-account, behind sign-in, never indexed, and it shows # an access token to the browser holding one. Disallow: /account Sitemap: https://parentfilter.app/sitemap.xml