{"id":1436,"date":"2011-07-27T12:54:53","date_gmt":"2011-07-27T12:54:53","guid":{"rendered":"https:\/\/supportex.net\/?p=1436"},"modified":"2019-05-10T20:59:15","modified_gmt":"2019-05-10T18:59:15","slug":"drbd-split-brain-solution-primaryprimary-setup","status":"publish","type":"post","link":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/","title":{"rendered":"DRBD split-brain solution in primary\/primary setup"},"content":{"rendered":"<p>Recently one of our customers DRBD cluster has detected split-brain:<\/p>\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">node2 kernel: block drbd1: Split-Brain detected, dropping connection!\nnode2 kernel: block drbd1: helper command: \/sbin\/drbdadm split-brain minor-1\nnode2 kernel: block drbd1: helper command: \/sbin\/drbdadm split-brain minor-1 exit code 0 (0x0)\n<\/pre>\n<p>This is \u00a0primary\/primary cluster. And to fix this issue we had to perform manual procedures since we don&#8217;t use automatic recovery feature.<br \/>\nAccording to the <a href=\"http:\/\/www.drbd.org\/users-guide\/s-resolve-split-brain.html\">DRDB official documentation<\/a> the solution is next.<\/p>\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">drbdadm secondary\ndrbdadm connect --discard-my-data\n<\/pre>\n<p>The problem is drbdadm doesn&#8217;t have \u00a0&#8216;&#8211;discard-my-data&#8217; \u00a0option and exits with error:<\/p>\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">[root@node2 ~]# drbdadm connect --discard-my-data wwwdata\ndrbdadm: unrecognized option '--discard-my-data'\ntry 'drbdadm help'\n[root@node2 ~]#\n<\/pre>\n<p>The issue can be solved in two ways.<\/p>\n<p>1. To perform command this way to pass this option directly to drbdsetup:<\/p>\n<p><code class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">drbdadm -- --discard-my-data connect wwwdata<\/code><\/p>\n<p>2. \u00a0To use option &#8211;verbose to get low-level drbdsetup output and run it with &#8216;&#8211;discard-my-data&#8217; :<\/p>\n<p><code class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">drbdsetup 1 net 10.209.1.1:7789 10.209.1.2:7789 C --set-defaults --create-device --allow-two-primaries &amp;amp;amp;amp;amp;amp;amp;nbsp;--discard-my-data<\/code><\/p>\n<p>After DRBD will sync you can change role of <em>split-brain victim<\/em> to primary.<\/p>\n<p><code class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">drbdadm primary wwwdata<\/code><\/p>\n<p>Problem solved.<\/p>\n<pre class=\"EnlighterJSRAW\" data-enlighter-language=\"shell\">[root@node2 ~]# cat \/proc\/drbd\nversion: 8.3.7 (api:88\/proto:86-91)\nGIT-hash: ea9e28dbff98e331a62bcbcc63a6135808fe2917 build by root@node2.example.com, 2010-01-28 08:37:51\n1:cs:Connected ro:Primary\/Primary ds:UpToDate\/UpToDate C r----\nns:125609294 nr:194649913 dw:320259208 dr:36731102 al:34129 bm:4042 lo:0 pe:0 ua:0 ap:0 ep:1 wo:d oos:0\n[root@node2 ~]#\n<\/pre>\n<p><strong>Didn&#8217;t find the answer to your question? <a href=\"\/contacts\/\">Ask it<\/a> our administrators to reply we will publish on website.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Recently one of our customers DRBD cluster has detected split-brain: node2 kernel: block drbd1: Split-Brain detected, dropping connection! node2 kernel: block drbd1: helper command: \/sbin\/drbdadm split-brain minor-1 node2 kernel: block drbd1: helper command: \/sbin\/drbdadm split-brain minor-1 exit code 0 (0x0) This is \u00a0primary\/primary cluster. And to fix this issue we had to perform manual procedures&hellip; <\/p>\n<div class=\"readmore-wrapper\"><a href=\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\" class=\"more-link\">Read <\/a><\/div>\n","protected":false},"author":4,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[152],"tags":[230,275],"class_list":["post-1436","post","type-post","status-publish","format-standard","hentry","category-linux","tag-drbd","tag-linux"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.8 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>DRBD split-brain solution in primary\/primary setup &#8211; Supportex.NET blog<\/title>\n<meta name=\"description\" content=\"How to resolve primary\/primary DRBD split-brain\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"DRBD split-brain solution in primary\/primary setup &#8211; Supportex.NET blog\" \/>\n<meta property=\"og:description\" content=\"How to resolve primary\/primary DRBD split-brain\" \/>\n<meta property=\"og:url\" content=\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\" \/>\n<meta property=\"og:site_name\" content=\"Supportex.NET blog\" \/>\n<meta property=\"article:published_time\" content=\"2011-07-27T12:54:53+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-05-10T18:59:15+00:00\" \/>\n<meta name=\"author\" content=\"Oleksii Tykhonov\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Oleksii Tykhonov\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\"},\"author\":{\"name\":\"Oleksii Tykhonov\",\"@id\":\"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/0690c26a0266603129fc15eae6243251\"},\"headline\":\"DRBD split-brain solution in primary\/primary setup\",\"datePublished\":\"2011-07-27T12:54:53+00:00\",\"dateModified\":\"2019-05-10T18:59:15+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\"},\"wordCount\":132,\"commentCount\":0,\"keywords\":[\"drbd\",\"linux\"],\"articleSection\":[\"linux\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\",\"url\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\",\"name\":\"DRBD split-brain solution in primary\/primary setup &#8211; Supportex.NET blog\",\"isPartOf\":{\"@id\":\"https:\/\/supportex.net\/blog\/en\/#website\"},\"datePublished\":\"2011-07-27T12:54:53+00:00\",\"dateModified\":\"2019-05-10T18:59:15+00:00\",\"author\":{\"@id\":\"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/0690c26a0266603129fc15eae6243251\"},\"description\":\"How to resolve primary\/primary DRBD split-brain\",\"breadcrumb\":{\"@id\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/supportex.net\/blog\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"DRBD split-brain solution in primary\/primary setup\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/supportex.net\/blog\/en\/#website\",\"url\":\"https:\/\/supportex.net\/blog\/en\/\",\"name\":\"Supportex.NET blog\",\"description\":\"Server and network management company\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/supportex.net\/blog\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/0690c26a0266603129fc15eae6243251\",\"name\":\"Oleksii Tykhonov\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4fd5f58002717075c88963469b9babef?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4fd5f58002717075c88963469b9babef?s=96&d=mm&r=g\",\"caption\":\"Oleksii Tykhonov\"},\"url\":\"https:\/\/supportex.net\/blog\/author\/oleksiitykhonov\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"DRBD split-brain solution in primary\/primary setup &#8211; Supportex.NET blog","description":"How to resolve primary\/primary DRBD split-brain","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/","og_locale":"en_US","og_type":"article","og_title":"DRBD split-brain solution in primary\/primary setup &#8211; Supportex.NET blog","og_description":"How to resolve primary\/primary DRBD split-brain","og_url":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/","og_site_name":"Supportex.NET blog","article_published_time":"2011-07-27T12:54:53+00:00","article_modified_time":"2019-05-10T18:59:15+00:00","author":"Oleksii Tykhonov","twitter_misc":{"Written by":"Oleksii Tykhonov","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#article","isPartOf":{"@id":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/"},"author":{"name":"Oleksii Tykhonov","@id":"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/0690c26a0266603129fc15eae6243251"},"headline":"DRBD split-brain solution in primary\/primary setup","datePublished":"2011-07-27T12:54:53+00:00","dateModified":"2019-05-10T18:59:15+00:00","mainEntityOfPage":{"@id":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/"},"wordCount":132,"commentCount":0,"keywords":["drbd","linux"],"articleSection":["linux"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/","url":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/","name":"DRBD split-brain solution in primary\/primary setup &#8211; Supportex.NET blog","isPartOf":{"@id":"https:\/\/supportex.net\/blog\/en\/#website"},"datePublished":"2011-07-27T12:54:53+00:00","dateModified":"2019-05-10T18:59:15+00:00","author":{"@id":"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/0690c26a0266603129fc15eae6243251"},"description":"How to resolve primary\/primary DRBD split-brain","breadcrumb":{"@id":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/supportex.net\/blog\/2011\/07\/drbd-split-brain-solution-primaryprimary-setup\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/supportex.net\/blog\/en\/"},{"@type":"ListItem","position":2,"name":"DRBD split-brain solution in primary\/primary setup"}]},{"@type":"WebSite","@id":"https:\/\/supportex.net\/blog\/en\/#website","url":"https:\/\/supportex.net\/blog\/en\/","name":"Supportex.NET blog","description":"Server and network management company","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/supportex.net\/blog\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/0690c26a0266603129fc15eae6243251","name":"Oleksii Tykhonov","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/supportex.net\/blog\/en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4fd5f58002717075c88963469b9babef?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4fd5f58002717075c88963469b9babef?s=96&d=mm&r=g","caption":"Oleksii Tykhonov"},"url":"https:\/\/supportex.net\/blog\/author\/oleksiitykhonov\/"}]}},"_links":{"self":[{"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/posts\/1436","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/comments?post=1436"}],"version-history":[{"count":2,"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/posts\/1436\/revisions"}],"predecessor-version":[{"id":3228,"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/posts\/1436\/revisions\/3228"}],"wp:attachment":[{"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/media?parent=1436"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/categories?post=1436"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/supportex.net\/blog\/wp-json\/wp\/v2\/tags?post=1436"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}