imported Csv not utf 8 in Phpmyadmin - database

I imported a .csv file with utf-8 to my phpmyadmin.
I set the Character encoding of the file to
utf-8,
the seperator to
;
and the rest to default.
The import worked successfully, but then I switched to the view of the "created database" and saw that all (German) Accents like:
Ü, Ö, Ä, ß..
Are replaced with
?
I guess something with the phpmyadmin unicode is wrong,
because my imported csv can show those accents.
Does anyone how a few tips or a solution?
EDIT:
I looked through the my.ini to check for the default character settings,
but they seem to be fine.
#collation_server=utf8_unicode_ci
#character_set_server=utf8
The Structur (next to view) in phpmyadmin also shows
utf8_general_ci

Importing a CSV file with special characters require the file be saved in a UTF-8 format. Please follow the steps below
Open the CSV file using text editor like Notepad(recommended).
Click File > Save As, enter a file name and change the encoding to UTF-8. Then click the Save button.
Now, import the file again and all the special characters should be properly imported.

Related

Text qualifier appears in data when using flat file

I have a flat file connection manager that reads data from a file that I have constructed with a Powershell script. The fields in the file are delimited with a vertical bar (|) and each field is qualified with the ¬ character (mainly because some fields contain either vertical bar or double quotes).
I have set up my flat file connection manager with the text qualifier specified like so:
Clicking on preview I can view the data just fine, everything appears to be working.
I then add a flat file source, hook it up to my flat file connection manager, hit the Preview button and that all looks great:
Yet, when I run the data flow, the text qualifier character (¬) is appearing in each field, like this:
Can someone please explain to me what is going on here? Because I cannot figure out why this is happening.
I tried the suggestions mentioned in the question below with no luck:
SSIS Flat File Source Text Qualifier being ignored

How do you import from CSV into SQL Server with a double text qualifier?

I have a problem with a SQL import from a CSV file that contains a text qualifier = "¬¬" i.e. only the part between the inverted commas. When I use the SQL Server Management Studio import tool I set the following:
The preview (all looks good - the way I would like it to import):
The output after the import (the problem):
This is what it replaces the text qualifier with: "¬¬"
I would appreciate any ideas on how to correct this issue thanks.
It seems that SSMS does not like the "¬¬" text qualifier for reasons unknown (perhaps relating to the encoding standard) and I found it easier to find and replace the qualifier with "^^^" using Notepad++. After importing the files again, the new qualifier worked without any further issues.
--Update--
Not sure why this did not seem as obvious before however using the odd output "¬¬" as the text qualifier solved this problem even better! Bear in mind that the preview text output using the import wizard will appear as being incorrect however the final output reflects correctly!

Filter text copied from PDF

I'm having a problem while copying text from a pdf to MS SQL Server. This pdf contains a query, which I'd like to copy to my MS SQL Server but when I do this he copies the text including some invisible symbols.
Here the first part of the query, copied from my PDF viewer:
IF​O​BJECT_ID​(​'​trgAantalIU',​'​TR')​​I​S​N​OT​N​ULL
D​ROP​T​RIGGER​trgAantalIU;​ GO
CREATE​T​RIGGER​trgAantalIUO​N​bezettingsregel AFTER​U​PDATE
AS
BEGIN
When I view this copied query in SQL Server it doesn't get the correct syntax highlighting and I discovered that there is an invisible symbol between the 'B' and the 'E' (it requires two backspaces to delete the B while the cursor was in front of the 'E', is why I know this).
My question is: how can I delete those invisible symbols? I cant find an option in MS SQL Server to do this for me.
I'm using OS X 10.11, and the included 'preview' app as pdf-viewer. MS SQL is running in a VM (Parallels Desktop, latest version).
There are a few things you can do to remove all the weird characters.
By far the easiest way to get rid of all these invisible characters is by using another application to paste text into without the actual formatting.
On Mac OS X you can use any text editor and paste the copied part into it with Shift-Option-Cmd + v to remove formatting.
If you are on windows you can copy/paste the code into notepad and it will lose all it's formatting (same thing works with mousepad, or leafpad) under Linux.
For Windows there is also an application which you can use known as "PureText".
A short description about puretext:
PureText only removes rich formatting from text. This includes the font face, font style (bold, italics, etc.), font color, paragraph styles (left/right/center aligned), margins, character spacing, bullets, subscript, superscript, tables, charts, pictures, embedded objects, etc. However, it does not modify the actual text. It will not remove or fix new-lines, carriage returns, tabs, or other white-space. It will not fix word-wrap or clean up your paragraphs. If you copy the source code of a web page to the clipboard, it is not going to remove all the HTML tags. If you copy text from an actual web page (not the source of the page), it will remove the formatting.

Unexpected line break when importing to SQL from SSIS

I when I import a pipe delimited .txt file I receive from a client every once in a while, one of my records will import into the raw table with a line break in the tuple. But when I look at the .txt file I see neither {CR}{LF} or {LF}.
I can't figure out why this is happening. Has anyone else ever experienced this?
I have had similar issues. I ended up stripping out any \n or \r escape characters from string data after it had already come into the data flow using either a derived column or a custom script component. That fixed the problem for me. It helps to enable the data viewer to see what the data looks like as you are debugging.
I have had issues like this before and found that in some cases SSIS could only recognize tabs, linefeeds, & carriage returns using the hexadecimal format:
x0009 - tab
x000A - feed
x000D - return
Try using something like this in your derived column:
(DT_STR,50,1252)TRIM(LOWER(REPLACE(REPLACE(REPLACE( *{your_column}*,"\x0009",""),"\x000A",""),"\x000D","")))

Joomla! russian language file ( ini ) issue

I am creating a multilanguage web site in joomla!. English and Russian. When I tried to edit the "languages/ru-RU.ini" and added the following line
CALLUS="озвоните нам"
When save and reopen the "ini" file then the "озвоните нам" part will goes like
CALLUS="????????? ???"
In main site also giving those question marks.
Any idea guys ?
Please help
Thanks in advance
Try open it with an editor like Notepad++ and make sure format->encode UTF-8 (No BOM) is selected, and if not then choose the Convert to UTF-8 (No BOM), and then save.
Should solve your problem.

Resources