What is the relation between dfc.date_format and dm_LogPurge? This is the\u00a0question we had to answer as we hit an issue. An issue with the dm_LogPurge job.
\nAs usual once a repository has been created we are configuring several Documentum jobs for the housekeeping.
\nOne of them is the dm_LogPurge. It is configured to run once a day with a cutoff_days of 90 days.
\nSo all ran fine until we did another change.
\nOn request of an application team we had to change the dfc.date_format to dfc.date_format=dd\/MMM\/yyyy HH:mm:ss\u00a0to allow the D2 clients to use Months in letters and not digits.
\nThis change fulfilled the application requirement but since that day, the dm_LogPurge job started to remove too many log files (to not write ALL). \ud83d\ude41<\/p>\n
So let’s explain how we proceed to find out the reason of the issue and more important the solution to avoid it.
\nWe have been informed not by seeing that too many files have been removed but by checking the repository log file. BTW, this file is checked automatically using nagios with our own dbi scripts. So in the repository log file we had errors like:<\/p>\n
2016-04-11T20:30:41.453453\u00a0\u00a0\u00a0\u00a0\u00a0 16395[16395]\u00a0\u00a0\u00a0 01xxxxxx80028223\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 [DM_OBJ_MGR_E_FETCH_FAIL]error:\u00a0\u00a0 \"attempt to fetch object with handle 06xxxxxx800213d2 failed \"\n2016-04-11T20:30:41.453504\u00a0\u00a0\u00a0\u00a0\u00a0 16395[16395]\u00a0\u00a0\u00a0 01xxxxxx80028223\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 [DM_SYSOBJECT_E_CANT_GET_CONTENT]error:\u00a0\u00a0 \"Cannot get\u00a0 format for 0 content of StateOfDocbase sysobject. \"\n2016-04-11T20:26:10.157989\u00a0\u00a0\u00a0\u00a0\u00a0 14679[14679]\u00a0\u00a0\u00a0 01xxxxxx80028220\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 [DM_OBJ_MGR_E_FETCH_FAIL]error:\u00a0\u00a0 \"attempt to fetch object with handle 06xxxxxx800213c7 failed \"\n2016-04-11T20:26:10.158059\u00a0\u00a0\u00a0\u00a0\u00a0 14679[14679]\u00a0\u00a0\u00a0 01xxxxxx80028220\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 [DM_SYSOBJECT_E_CANT_GET_CONTENT]error:\u00a0\u00a0 \"Cannot get\u00a0 format for 0 content\n<\/pre>\n<\/p>\n
Based on the time stamp, I saw that the issue could be related to the dm_LogPurge. So I checked the job log file as well the folders which are cleaned out. In the folder all old log files were removed:<\/p>\n
[dmadmin@content_server_01 log]$ date\nWed Apr 13 06:28:35 UTC 2016\n[dmadmin@content_server_01 log]$ pwd\n$DOCUMENTUM\/dba\/log\n[dmadmin@content_server_01 log]$ ls -ltr REPO1*\nlrwxrwxrwx. 1 dmadmin dmadmin 34 Oct 22 09:14 REPO1 -> $DOCUMENTUM\/dba\/log\/<hex docbaseID>\/\n-rw-rw-rw-. 1 dmadmin dmadmin 8540926 Apr 13 06:28 REPO1.log<\/pre>\n<\/p>\n
To have more information, I set the trace level of the dm_LogPurge job to 10 and analyzed the trace file.
\nIn the trace file we had:<\/p>\n[main] com.documentum.dmcl.impl.DmclApiNativeAdapter@9276326.get( \"get,c,sessionconfig,r_date_format \") ==> \"31\/1212\/1995 24:00:00 \"\n[main] com.documentum.dmcl.impl.DmclApiNativeAdapter@9276326.get( \"get,c,08xxxxxx80000362,method_arguments[ 1] \") ==> \"-cutoff_days 90 \"<\/pre>\n<\/p>\n
So why did we have 31\/1212\/1995<\/strong> ?<\/p>\n
Using API I confirmed an issue related to the date format<\/p>\n
API> get,c,sessionconfig,r_date_format\n...\n31\/1212\/1995 24:00:00\n\nAPI> ?,c,select date(now) as dateNow from dm_server_config\ndatenow\n-------------------------\n14\/Apr\/2016 08:36:52\n\n(1 row affected)\n\n<\/pre>\n<\/p>\n
Date format? So as all our changes are documented, I easily found that we changed the dfc_date_format for the D2 application.
\nBy cross-checking with another installation, used by another application where we did not change the dfc.date_format, I could confirm that the issue was related to this dfc parameter change.<\/p>\nWithout dfc.date_format in dfc.properties:<\/p>\n
API> get,c,sessionconfig,r_date_format\n...\n12\/31\/1995 24:00:00\n\nAPI> ?,c,select date(now) as dateNow from dm_server_config\ndatenow\n-------------------------\n4\/14\/2016 08:56:13\n\n(1 row affected)\n<\/pre>\n<\/p>\n
Just to be sure that I did not miss something, I checked also if not all log files were removed after starting manually the job. They were still there.
\nNow the solution would be to rollback the dfc.date_format change but this would only help the platform but not the application team. As the initial dfc.date_format change was validated by EMC we had to find a solution for both teams.<\/p>\nAfter investigating we found the final solution:
\nAdd dfc.date_format=dd\/MMM\/yyyyy HH:mm:ss in the dfc.properties file of the ServerApps (in the JMS directly so!)<\/p>\nWith this solution the dm_LogPurge job does not remove too many files and the Application Team\u00a0can still use the Month written in letters in its D2 applications.<\/p>\n
<\/p>\n","protected":false},"excerpt":{"rendered":"
What is the relation between dfc.date_format and dm_LogPurge? This is the\u00a0question we had to answer as we hit an issue. An issue with the dm_LogPurge job. As usual once a repository has been created we are configuring several Documentum jobs for the housekeeping. One of them is the dm_LogPurge. It is configured to run once […]<\/p>\n","protected":false},"author":24,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[525],"tags":[129,101,44],"type_dbi":[],"class_list":["post-8989","post","type-post","status-publish","format-standard","hentry","category-enterprise-content-management","tag-documentum","tag-installation","tag-troubleshooting"],"acf":[],"yoast_head":"\n
Documentum story - dm_LogPurge and dfc.date_format - dbi Blog<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Documentum story - dm_LogPurge and dfc.date_format\" \/>\n<meta property=\"og:description\" content=\"What is the relation between dfc.date_format and dm_LogPurge? This is the\u00a0question we had to answer as we hit an issue. An issue with the dm_LogPurge job. As usual once a repository has been created we are configuring several Documentum jobs for the housekeeping. One of them is the dm_LogPurge. It is configured to run once […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/\" \/>\n<meta property=\"og:site_name\" content=\"dbi Blog\" \/>\n<meta property=\"article:published_time\" content=\"2016-10-12T08:05:55+00:00\" \/>\n<meta name=\"author\" content=\"G\u00e9rard Wisson\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"G\u00e9rard Wisson\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/\"},\"author\":{\"name\":\"G\u00e9rard Wisson\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/ad54b5e621903122c00c6b7921c6ab85\"},\"headline\":\"Documentum story – dm_LogPurge and dfc.date_format\",\"datePublished\":\"2016-10-12T08:05:55+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/\"},\"wordCount\":498,\"commentCount\":0,\"keywords\":[\"Documentum\",\"Installation\",\"Troubleshooting\"],\"articleSection\":[\"Enterprise content management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/\",\"name\":\"Documentum story - dm_LogPurge and dfc.date_format - dbi Blog\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#website\"},\"datePublished\":\"2016-10-12T08:05:55+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/ad54b5e621903122c00c6b7921c6ab85\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/documentum-story-dm_logpurge-and-dfc-date_format\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Accueil\",\"item\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Documentum story – dm_LogPurge and dfc.date_format\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#website\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/\",\"name\":\"dbi Blog\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/#\\\/schema\\\/person\\\/ad54b5e621903122c00c6b7921c6ab85\",\"name\":\"G\u00e9rard Wisson\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1eb607e2c436690f1f57c55db47a3fabb0d11955ea9a2510605d5e5813632408?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1eb607e2c436690f1f57c55db47a3fabb0d11955ea9a2510605d5e5813632408?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1eb607e2c436690f1f57c55db47a3fabb0d11955ea9a2510605d5e5813632408?s=96&d=mm&r=g\",\"caption\":\"G\u00e9rard Wisson\"},\"description\":\"G\u00e9rard Wisson has more than ten years of experience in Enterprise Content Management (ECM) with Documentum as well as in Oracle WebLogic and Java EE \\\/ J2EE infrastructures. He is specialized in ECM infrastructure services such as installation, upgrade, high availability, and administration as well as in Oracle WebLogic services such as installation, configuration, and management. He is very experienced in the monitoring and optimization of Java EE \\\/ J2EE infrastructures with Grid\\\/Cloud Control and JVMD. G\u00e9rard Wisson is certified Oracle Weblogic Server 11g System Administrator and Oracle Certified Associate. Prior to joining dbi services, G\u00e9rard Wisson was Senior Consultant at Solfit in Basel. He holds a diploma in Electrical Engineering from the University of Strasbourg (F). His branch-related experience covers Financial Services \\\/ Banking, Chemicals & Pharmaceuticals, etc.\",\"url\":\"https:\\\/\\\/www.dbi-services.com\\\/blog\\\/author\\\/gerard-wisson\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Documentum story - dm_LogPurge and dfc.date_format - dbi Blog","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/","og_locale":"en_US","og_type":"article","og_title":"Documentum story - dm_LogPurge and dfc.date_format","og_description":"What is the relation between dfc.date_format and dm_LogPurge? This is the\u00a0question we had to answer as we hit an issue. An issue with the dm_LogPurge job. As usual once a repository has been created we are configuring several Documentum jobs for the housekeeping. One of them is the dm_LogPurge. It is configured to run once […]","og_url":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/","og_site_name":"dbi Blog","article_published_time":"2016-10-12T08:05:55+00:00","author":"G\u00e9rard Wisson","twitter_card":"summary_large_image","twitter_misc":{"Written by":"G\u00e9rard Wisson","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/#article","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/"},"author":{"name":"G\u00e9rard Wisson","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/ad54b5e621903122c00c6b7921c6ab85"},"headline":"Documentum story – dm_LogPurge and dfc.date_format","datePublished":"2016-10-12T08:05:55+00:00","mainEntityOfPage":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/"},"wordCount":498,"commentCount":0,"keywords":["Documentum","Installation","Troubleshooting"],"articleSection":["Enterprise content management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/","url":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/","name":"Documentum story - dm_LogPurge and dfc.date_format - dbi Blog","isPartOf":{"@id":"https:\/\/www.dbi-services.com\/blog\/#website"},"datePublished":"2016-10-12T08:05:55+00:00","author":{"@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/ad54b5e621903122c00c6b7921c6ab85"},"breadcrumb":{"@id":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.dbi-services.com\/blog\/documentum-story-dm_logpurge-and-dfc-date_format\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Accueil","item":"https:\/\/www.dbi-services.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Documentum story – dm_LogPurge and dfc.date_format"}]},{"@type":"WebSite","@id":"https:\/\/www.dbi-services.com\/blog\/#website","url":"https:\/\/www.dbi-services.com\/blog\/","name":"dbi Blog","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.dbi-services.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.dbi-services.com\/blog\/#\/schema\/person\/ad54b5e621903122c00c6b7921c6ab85","name":"G\u00e9rard Wisson","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1eb607e2c436690f1f57c55db47a3fabb0d11955ea9a2510605d5e5813632408?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1eb607e2c436690f1f57c55db47a3fabb0d11955ea9a2510605d5e5813632408?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1eb607e2c436690f1f57c55db47a3fabb0d11955ea9a2510605d5e5813632408?s=96&d=mm&r=g","caption":"G\u00e9rard Wisson"},"description":"G\u00e9rard Wisson has more than ten years of experience in Enterprise Content Management (ECM) with Documentum as well as in Oracle WebLogic and Java EE \/ J2EE infrastructures. He is specialized in ECM infrastructure services such as installation, upgrade, high availability, and administration as well as in Oracle WebLogic services such as installation, configuration, and management. He is very experienced in the monitoring and optimization of Java EE \/ J2EE infrastructures with Grid\/Cloud Control and JVMD. G\u00e9rard Wisson is certified Oracle Weblogic Server 11g System Administrator and Oracle Certified Associate. Prior to joining dbi services, G\u00e9rard Wisson was Senior Consultant at Solfit in Basel. He holds a diploma in Electrical Engineering from the University of Strasbourg (F). His branch-related experience covers Financial Services \/ Banking, Chemicals & Pharmaceuticals, etc.","url":"https:\/\/www.dbi-services.com\/blog\/author\/gerard-wisson\/"}]}},"_links":{"self":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/8989","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/users\/24"}],"replies":[{"embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/comments?post=8989"}],"version-history":[{"count":0,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/posts\/8989\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/media?parent=8989"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/categories?post=8989"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/tags?post=8989"},{"taxonomy":"type","embeddable":true,"href":"https:\/\/www.dbi-services.com\/blog\/wp-json\/wp\/v2\/type_dbi?post=8989"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}