{"id":919354,"date":"2014-12-15T20:56:02","date_gmt":"2014-12-16T04:56:02","guid":{"rendered":"https:\/\/tri.be\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/"},"modified":"2015-01-21T08:09:57","modified_gmt":"2015-01-21T16:09:57","slug":"how-to-clean-non-utf8-chars-from-database-or-csv-file","status":"closed","type":"topic","link":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/","title":{"rendered":"How to clean non-UTF8 chars from database or CSV file"},"content":{"rendered":"<p>Okay, this isn&#8217;t a problem specific to The Events Calendar, but &#8230;<br \/>\nOn the page to import a CSV file of events created outside of The Events Calendar, it says to be careful that the import file is UTF8 and gives a link to a tool to check that. The tool says everything&#8217;s fine, but there are some garbage characters (versions of &#8220;fancy&#8221; quotes, em\/en dashes, etc.) in the file. I&#8217;ve been searching for tutorials and examples on how to clean those up, but I haven&#8217;t found anything that matches my specific case. [For instance, od tells me there&#8217;s a 240 in the post_content column for a particular post, but I can&#8217;t seem to run a SELECT that will find that record, so I&#8217;ve no idea how to craft the UPDATE to fix it.]<br \/>\nSo I thought I&#8217;d post here in case someone has a good tutorial. (Because yes, importing posts with that kind of bad data does cause The Events Calendar to fail in odd ways.)<\/p>\n<p>[I&#8217;m using an export file created from data that another events plugin created, so I could fix the data before the export. A solution to that would be preferable since the problem occurs in non-event posts. But if there&#8217;s a solution for the CSV file, that&#8217;d be a help.]<\/p>\n","protected":false},"template":"","class_list":["post-919354","topic","type-topic","status-closed","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.2 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>How to clean non-UTF8 chars from database or CSV file -<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to clean non-UTF8 chars from database or CSV file -\" \/>\n<meta property=\"og:description\" content=\"Okay, this isn&#8217;t a problem specific to The Events Calendar, but &#8230; On the page to import a CSV file of events created outside of The Events Calendar, it says to be careful that the import file is UTF8 and gives a link to a tool to check that. The tool says everything&#8217;s fine, but [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/\" \/>\n<meta property=\"article:modified_time\" content=\"2015-01-21T16:09:57+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/\",\"url\":\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/\",\"name\":\"How to clean non-UTF8 chars from database or CSV file -\",\"isPartOf\":{\"@id\":\"https:\/\/theeventscalendar.com\/support\/#website\"},\"datePublished\":\"2014-12-16T04:56:02+00:00\",\"dateModified\":\"2015-01-21T16:09:57+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/theeventscalendar.com\/support\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Topics\",\"item\":\"https:\/\/theeventscalendar.com\/support\/topics\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Calendar Products\",\"item\":\"https:\/\/theeventscalendar.com\/support\/forums\/forum\/events\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Events Calendar PRO\",\"item\":\"https:\/\/theeventscalendar.com\/support\/forums\/forum\/events\/events-calendar-pro\/\"},{\"@type\":\"ListItem\",\"position\":5,\"name\":\"How to clean non-UTF8 chars from database or CSV file\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/theeventscalendar.com\/support\/#website\",\"url\":\"https:\/\/theeventscalendar.com\/support\/\",\"name\":\"\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/theeventscalendar.com\/support\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to clean non-UTF8 chars from database or CSV file -","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/","og_locale":"en_US","og_type":"article","og_title":"How to clean non-UTF8 chars from database or CSV file -","og_description":"Okay, this isn&#8217;t a problem specific to The Events Calendar, but &#8230; On the page to import a CSV file of events created outside of The Events Calendar, it says to be careful that the import file is UTF8 and gives a link to a tool to check that. The tool says everything&#8217;s fine, but [&hellip;]","og_url":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/","article_modified_time":"2015-01-21T16:09:57+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/","url":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/","name":"How to clean non-UTF8 chars from database or CSV file -","isPartOf":{"@id":"https:\/\/theeventscalendar.com\/support\/#website"},"datePublished":"2014-12-16T04:56:02+00:00","dateModified":"2015-01-21T16:09:57+00:00","breadcrumb":{"@id":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/theeventscalendar.com\/support\/forums\/topic\/how-to-clean-non-utf8-chars-from-database-or-csv-file\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/theeventscalendar.com\/support\/"},{"@type":"ListItem","position":2,"name":"Topics","item":"https:\/\/theeventscalendar.com\/support\/topics\/"},{"@type":"ListItem","position":3,"name":"Calendar Products","item":"https:\/\/theeventscalendar.com\/support\/forums\/forum\/events\/"},{"@type":"ListItem","position":4,"name":"Events Calendar PRO","item":"https:\/\/theeventscalendar.com\/support\/forums\/forum\/events\/events-calendar-pro\/"},{"@type":"ListItem","position":5,"name":"How to clean non-UTF8 chars from database or CSV file"}]},{"@type":"WebSite","@id":"https:\/\/theeventscalendar.com\/support\/#website","url":"https:\/\/theeventscalendar.com\/support\/","name":"","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/theeventscalendar.com\/support\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/theeventscalendar.com\/support\/wp-json\/wp\/v2\/topic\/919354","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/theeventscalendar.com\/support\/wp-json\/wp\/v2\/topic"}],"about":[{"href":"https:\/\/theeventscalendar.com\/support\/wp-json\/wp\/v2\/types\/topic"}],"version-history":[{"count":1,"href":"https:\/\/theeventscalendar.com\/support\/wp-json\/wp\/v2\/topic\/919354\/revisions"}],"predecessor-version":[{"id":935696,"href":"https:\/\/theeventscalendar.com\/support\/wp-json\/wp\/v2\/topic\/919354\/revisions\/935696"}],"wp:attachment":[{"href":"https:\/\/theeventscalendar.com\/support\/wp-json\/wp\/v2\/media?parent=919354"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}