{"id":232,"date":"2017-05-30T02:43:46","date_gmt":"2017-05-30T07:43:46","guid":{"rendered":"http:\/\/www.paulreed.ca\/?p=232"},"modified":"2017-05-30T02:55:24","modified_gmt":"2017-05-30T07:55:24","slug":"custom-facts-on-windows-with-puppet-and-xff-errors","status":"publish","type":"post","link":"https:\/\/paulreed.ca\/?p=232","title":{"rendered":"Custom Facts on Windows with Puppet and “”\\xFF”” Errors"},"content":{"rendered":"

Hi All,<\/p>\n

It’s been a long while since I posted last (as usual). It’s also been a long while since I started working for Puppet.<\/p>\n

Until now, I haven’t really found much puppet things to blog about, but that’s about to change.<\/p>\n

Lets start with something I ran into today. Custom Facts on Windows with Puppet!<\/p>\n

Coincidentally, while working on something else, I dropped a fact into my facts.d folder and went on working on other things … only to bang my head against a wall for a few hours.<\/p>\n

Custom facts are easy in Puppet!<\/h2>\n

“Custom facts are easy”, you say… “All I need to do is drop something like this on the OS”:
\necho my_custom_fact=value123 > C:\\ProgramData\\PuppetLabs\\facter\\facts.d\\my_custom_fact.txt
\n<\/code>[Note: The code above is a single wrapped line]<\/em><\/p>\n

\"echo<\/a><\/p>\n

… and you would be wrong. L<\/code>ike I was. That method works fine for posix based systems … but not for Windows (read on to learn why, and how to work around it).<\/p>\n

Of course, I figured my fact was fine … it created the file and the file looked okay, so I went on trying to troubleshoot the other thing I was working on while getting this error when running the puppet agent (“puppet agent -t”) on my node:
\n\"\"<\/a><\/p>\n

What the hell does that mean? \\xFF? …<\/p>\n

File encoding types… ugh.<\/h2>\n

Well, after some google-fu, turns out that \\xFF is one of the starting byte codes for a file encoding type …. ok, so it looks like a file encoding error.
\nSo like a dumbass, I was checking all my other files and certificate properties, even rebuilt the VM a few (dozen) times (because that’s what I was working on when I hit this error)… not realizing all along it was the filetype of my custom fact that was causing this bullsh*t.<\/p>\n

Ok … so what’s going on here?
\n\"\"<\/a><\/p>\n

It turns out Puppet on Windows really doesn’t like things that aren’t UTF8 encoded… especially in facter …. and the error output is basically useless because it doesn’t point you in the direction of factor or the custom facts.d file at all.<\/p>\n

That’s right, hours and many rebuilds of my VM because windows “echo >” in Windows decides to create files in “UCS-2 Little Endian” encoding … and Puppet (or well, more likely some of the ruby code in behind it for facter) can’t properly decode\/re-encode Windows UCS-2 to UTF-8.<\/p>\n

Okay, great … save the file in UTF8, and away we go…
\n\"\"<\/a><\/p>\n

BTW, You’ll need to run puppet agent twice to clear out the old, wrongly encoded fact from your master to get a clean run…
\n\"\"<\/a><\/p>\n

But…. Automation? Scripting?<\/h2>\n

Well … we can’t very well use the “echo something > facts.d\/something.txt”<\/em> method anymore …. so what’s the fix that I can use in an automated process?<\/p>\n

Powershell to the rescue!<\/strong><\/p>\n

Here’s a way to do it that will create a proper UTF-8 file that Puppet\/facter can read:
\necho \"my_custom_fact=value123\" | out-file -filepath C:\\ProgramData\\PuppetLabs\\facter\\facts.d\\my_custom_fact.txt -encoding UTF<\/code>
\n[Note: The code above is a single wrapped line]
\n<\/em>
\n\"\"<\/a><\/p>\n

That’ll do it … of course, if you’re not working in powershell (or using a provisioning shell from vagrant like I am), then you just need to wrap it in a call to powershell like so (and make sure you escape your quotes properly using backticks and not single quotes!):
\npowershell -Command \"echo `\"my_custom_fact=value123`\" | out-file -filepath C:\\ProgramData\\PuppetLabs\\facter\\facts.d\\my_custom_fact.txt -encoding UTF8\"<\/code>
\n[Note: The code above is a single wrapped line]<\/em><\/p>\n

Ok, That’s it … hours of figuring out WTF was happening so you don’t have to go through it yourself … hopefully google will pick this up for searches on ‘Puppet Windows “”\\xFF”” errors’ and save you some time.<\/p>\n

Until next time!
\n-Paul<\/p>\n","protected":false},"excerpt":{"rendered":"

Hi All, It’s been a long while since I posted last (as usual). It’s also been a long while since I started working for Puppet. Until now, I haven’t really found much puppet things to blog about, but that’s about to change. Lets start with something I ran into today. Custom Facts on Windows with […]<\/p>\n","protected":false},"author":1,"featured_media":251,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,54,21],"tags":[56,55,46,57],"_links":{"self":[{"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/posts\/232"}],"collection":[{"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/paulreed.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=232"}],"version-history":[{"count":11,"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/posts\/232\/revisions"}],"predecessor-version":[{"id":249,"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/posts\/232\/revisions\/249"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/paulreed.ca\/index.php?rest_route=\/wp\/v2\/media\/251"}],"wp:attachment":[{"href":"https:\/\/paulreed.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=232"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/paulreed.ca\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=232"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/paulreed.ca\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=232"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}