Skip to content

mendelu: disallow heavy Discovery facet/pagination browse URLs (cherry-pick upstream 9b03e82a14) - #1650

Open
Kasinhou wants to merge 1 commit into
customer/mendelufrom
fix/robots-spc-page-1085-mendelu
Open

Kasinhou wants to merge 1 commit into
customer/mendelufrom
fix/robots-spc-page-1085-mendelu

Conversation

@Kasinhou

Copy link
Copy Markdown

What

Cherry-pick of upstream DSpace/dspace-angular@9b03e82a14 — adds two directives to the User-agent: * block:

# Heavy Discovery facet queries on browse pages
Disallow: /collections/*?f
Disallow: /communities/*?spc.page

Why mendelu (and why not the 7.x branches)

mendelu is on 9.1.0. On 8.x+ the community landing page renders the search section on the bare /communities/<uuid> route (it's the default empty-path child route → ComcolSearchSectionComponent, paginationId spc). So its pagination is emitted as /communities/<uuid>?spc.page=N, which the existing rules do not cover:

  • Disallow: /communities/*/search needs the /search segment (absent here)
  • Disallow: /*?f. / /*&f. only match facet params (f.), not spc.page

So this rule adds genuinely new coverage on 9.x. (/collections/*?f is largely redundant with the existing /*?f., kept only for parity with upstream/jcu.)

This is not applied to the 7.x customer branches (TUL, zcu-data, zcu-pub, lindat, vsb-tuo, sav, uk): there the community page has a separate /communities/<uuid>/search route (no default search on the landing URL), so ?spc.page is never generated and the rule would be a no-op. Verified via community-page.component.html (9.x has <router-outlet>, 7.x does not) and community-page-routes.ts (9.x has path: '' → ComcolSearchSectionComponent).

jcu already has these rules, so it is unchanged.

Refs dataquest-dev/dspace-customers#1085

🤖 Generated with Claude Code

Cherry-pick of upstream DSpace/dspace-angular 9b03e82. On 8.x+ the
community landing page renders the search section on the bare
/communities/<uuid> route (default child route), so its pagination is
emitted as /communities/<uuid>?spc.page=N - not covered by the existing
/communities/*/search or facet rules. Also blocks /collections/*?f.

Not applied to 7.x branches: there the community page has no such route,
so ?spc.page is never generated.

Refs dataquest-dev/dspace-customers#1085

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@Kasinhou Kasinhou self-assigned this Oct 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant