XQuery Expressions (I would say usual expressions) : <\/p>\n
- \n
- For : selects a sequence of nodes<\/li>\n
- Let : binds a sequence to a variable<\/li>\n
- Where : filters the nodes<\/li>\n
- Order by : sorts the nodes<\/li>\n
- Return : what to return (gets evaluated once for every node)<\/li>\n<\/ul>\n
As an example, the below books.xml file:<\/p>\n
\n<?xml version="1.0" encoding="UTF-8"?>\n\n<bookstore>\n\n\t<book category="CATEGORY 1">\n\t\t<title lang="en">PRODUCT 2<\/title>\n\t\t<author>AUTHOR 1<\/author>\n\t\t<year>2017<\/year>\n\t\t<price>100<\/price>\n\t<\/book>\n\t\n\t<book category="CATEGORY 2">\n\t\t<title lang="en">PRODUCT 1<\/title>\n\t\t<author>AUTHOR 1<\/author>\n\t\t<author>AUTHOR 2<\/author>\n\t\t<year>2018<\/year>\n\t\t<price>200<\/price>\n\t<\/book>\n\t\n\t<book category="CATEGORY 2">\n\t\t<title lang="en">PRODUCT 3<\/title>\n\t\t<author>AUTHOR 3<\/author>\n\t\t<year>2015<\/year>\n\t\t<price>20<\/price>\n\t<\/book>\n\n<\/bookstore> \n<\/pre>\n
Example 1:<\/strong>
\nQuery :<\/p>\n\nfor $x in doc(\"books.xml\")\/bookstore\/book\nwhere $x\/price>30\nreturn $x\/title \n<\/pre>\n
Result:<\/p>\n
\n<title lang="en">PRODUCT 2<\/title>\n<title lang="en">PRODUCT 1<\/title>\n<\/pre>\n
Example 2:<\/strong>
\nQuery :<\/p>\n\n
- \n {\n for $x in doc(\"books.xml\")\/bookstore\/book\/title\n order by $x\n return
- {data($x)}<\/li>\n }\n <\/ul> \n<\/pre>\n
Result:<\/p>\n
\n<ul>\n<li>PRODUCT 1<\/li>\n<li>PRODUCT 2<\/li>\n<li>PRODUCT 3<\/li>\n<\/ul> \n<\/pre>\n
How XQuery solved my issue?<\/h1>\n
Now, let’s come back to the Documentum FullText world, in the Documentum xPlore Administrator under “Diagnostic and Utilities” -> “Test Search”, you can make search by keyword, or execute a XQuery:
\n![](\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png\")
\nThe below query means:<\/p>\n\nlet $j:= for $i score $s in \/dmftdoc[. ftcontains 'TESTFT' with stemming using stop words default] order by $s descending \nreturn <b> {$i\/dmftmetadata\/\/r_object_id} { $i\/dmftmetadata\/\/object_name } { $i\/dmftmetadata\/\/r_modifier } return subsequence($j,1,200) <\/b>\n<\/pre>\n- \n
- $s correspond to all dmftdoc entries containing “TESTFT” word, in a descending order.<\/li>\n
- $i correspond to each line in $s.<\/li>\n
- For each $i return the r_object_id, object_name, and r_modifier.<\/li>\n
- The returned data are put in $j.<\/li>\n
- subsequence is a XQuery function, where:<\/li>\n
- – $j : is a sequence, and can contain 0 or more items.<\/ol>\n
- – index of items from which sub-sequence is to be created. Index starts from 1 here.<\/ol>\n
- – length of subsequence, here 200.<\/ol>\n<\/ul>\n
From this default query you can make yours, but how to know the XML structure?
\nIn fact, I make any search to get any result, then click on any line :
\n![](\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-11.jpg\")
<\/p>\nThe dmftdoc for this document will appear and you can take it as a base to build your query, for example:
\n![](\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-2.png\")
\nE.g. You can select only hidden documents (see the below query).<\/em><\/p>\nTo solve my issue and select only documents partially indexed, I executed the below query:<\/p>\n
\nlet $j:= for $i score $s in \/dmftdoc[.] order by $s descending \nwhere not(exists($i\/dmftdsearchinternals\/dmftsummarytokens_0))\nreturn <d> {$i\/dmftmetadata\/\/r_object_id} { $i\/dmftmetadata\/\/object_name } { $i\/dmftmetadata\/\/a_content_type } <\/d>\nreturn subsequence($j,1,1500)\n<\/pre>\nThe condition here is not anymore the content of the document, I am looking here for all documents not having dmftsummarytokens_0, if so, the r_object_id, object_name, and a_content_type are listed. Moreover, I limited the display to 1500 documents to be handled easily after.<\/p>\n
Other useful XQueries:<\/strong>
\n– List documents indexed as hidden:<\/p>\n\nlet $j:= for $i score $s in \/dmftdoc[.] order by $s descending \nwhere (($i\/dmftmetadata\/\/a_is_hidden)="true")\nreturn <d> {$i\/dmftmetadata\/\/r_object_id} { $i\/dmftmetadata\/\/object_name } { $i\/dmftmetadata\/\/a_content_type } <\/d>\nreturn subsequence($j,1,150)\n<\/pre>\n– List documents having content size equal to zero:<\/p>\n
\nlet $j:= for $i score $s in \/dmftdoc[.] order by $s descending \nwhere (($i\/dmftmetadata\/\/r_content_size)=0)\nreturn <d> {$i\/dmftmetadata\/\/r_object_id} { $i\/dmftmetadata\/\/object_name } { $i\/dmftmetadata\/\/a_content_type } <\/d>\nreturn subsequence($j,1,150)\n<\/pre>\nXQuery search helped me to solve many issues, and you? Did you already experienced it in this context?<\/p>\n","protected":false},"excerpt":{"rendered":"
At a customer we encountered some issues with FT Search after documents migration. In fact, some documents were not indexed correctly or partially indexed, the need was to know which documents are impacted to resubmit the indexing again. The FTIntegrity tool is not able to give the needed result, so the only way was XQuery […]<\/p>\n","protected":false},"author":46,"featured_media":13123,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[197],"tags":[129,1072,1772],"type_dbi":[],"class_list":["post-13122","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-application-integration-middleware","tag-documentum","tag-ft","tag-xquery"],"acf":[],"yoast_head":"\n
Documentum - FT - XQuery is very useful - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Documentum - FT - XQuery is very useful\" \/>\n<meta property=\"og:description\" content=\"At a customer we encountered some issues with FT Search after documents migration. In fact, some documents were not indexed correctly or partially indexed, the need was to know which documents are impacted to resubmit the indexing again. The FTIntegrity tool is not able to give the needed result, so the only way was XQuery […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2019-12-03T06:28:28+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"906\" \/>\n\t<meta property=\"og:image:height\" content=\"312\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"David Diab\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"David Diab\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/\"},\"author\":{\"name\":\"David Diab\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/deb907c3360cacdc6c7df54b4bac3c86\"},\"headline\":\"Documentum – FT – XQuery is very useful\",\"datePublished\":\"2019-12-03T06:28:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/\"},\"wordCount\":865,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/04\\\/Blog-FT-XQuery-1.png\",\"keywords\":[\"Documentum\",\"FT\",\"xquery\"],\"articleSection\":[\"Application integration & Middleware\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/\",\"name\":\"Documentum - FT - XQuery is very useful - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/04\\\/Blog-FT-XQuery-1.png\",\"datePublished\":\"2019-12-03T06:28:28+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/deb907c3360cacdc6c7df54b4bac3c86\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/04\\\/Blog-FT-XQuery-1.png\",\"contentUrl\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/wp-content\\\/uploads\\\/sites\\\/2\\\/2022\\\/04\\\/Blog-FT-XQuery-1.png\",\"width\":906,\"height\":312},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-ft-xquery-is-very-useful\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Documentum – FT – XQuery is very useful\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/deb907c3360cacdc6c7df54b4bac3c86\",\"name\":\"David Diab\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/212b1b2e4650bad3116f644ab4fb4663786d94195d7685d0704c8426da088e60?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/212b1b2e4650bad3116f644ab4fb4663786d94195d7685d0704c8426da088e60?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/212b1b2e4650bad3116f644ab4fb4663786d94195d7685d0704c8426da088e60?s=96&d=mm&r=g\",\"caption\":\"David Diab\"},\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/author\\\/david-diab\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Documentum - FT - XQuery is very useful - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/","og_locale":"en_US","og_type":"article","og_title":"Documentum - FT - XQuery is very useful","og_description":"At a customer we encountered some issues with FT Search after documents migration. In fact, some documents were not indexed correctly or partially indexed, the need was to know which documents are impacted to resubmit the indexing again. The FTIntegrity tool is not able to give the needed result, so the only way was XQuery […]","og_url":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/","og_site_name":"dbi Blog","article_published_time":"2019-12-03T06:28:28+00:00","og_image":[{"width":906,"height":312,"url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png","type":"image\/png"}],"author":"David Diab","twitter_card":"summary_large_image","twitter_misc":{"Written by":"David Diab","Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/"},"author":{"name":"David Diab","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/deb907c3360cacdc6c7df54b4bac3c86"},"headline":"Documentum – FT – XQuery is very useful","datePublished":"2019-12-03T06:28:28+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/"},"wordCount":865,"commentCount":0,"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png","keywords":["Documentum","FT","xquery"],"articleSection":["Application integration & Middleware"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/","url":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/","name":"Documentum - FT - XQuery is very useful - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#primaryimage"},"image":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#primaryimage"},"thumbnailUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png","datePublished":"2019-12-03T06:28:28+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/deb907c3360cacdc6c7df54b4bac3c86"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#primaryimage","url":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png","contentUrl":"https:\/\/www.dbi-services.com\/blog\/wp-content\/uploads\/sites\/2\/2022\/04\/Blog-FT-XQuery-1.png","width":906,"height":312},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-ft-xquery-is-very-useful\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Documentum – FT – XQuery is very useful"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/deb907c3360cacdc6c7df54b4bac3c86","name":"David Diab","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/212b1b2e4650bad3116f644ab4fb4663786d94195d7685d0704c8426da088e60?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/212b1b2e4650bad3116f644ab4fb4663786d94195d7685d0704c8426da088e60?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/212b1b2e4650bad3116f644ab4fb4663786d94195d7685d0704c8426da088e60?s=96&d=mm&r=g","caption":"David Diab"},"url":"https:\/\/www.dbi-services.com\/blog\/author\/david-diab\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/13122","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/46"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=13122"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/13122\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media\/13123"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=13122"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=13122"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=13122"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=13122"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
- {data($x)}<\/li>\n }\n <\/ul> \n<\/pre>\n