The T World

[haskell]iniファイルとexception

ini形式のデータをパースして値を取得できるようにします。また、ファイルが無いときの例外キャッチをできるようにします。

{-# LANGUAGE ScopedTypeVariables #-}
module Main where
import qualified Data.HashMap as HM
import qualified Data.Ini as Ini
import qualified Data.Text as Tx
import Control.Exception.Safe

main::IO ()
main = do
    fi < - Ini.readIniFile "test.ini"
     `catch` (\(e::SomeException) -> do
       putStrLn $ displayException e
       return $ Ini.parseIni (Tx.pack "")
     )
    case fi of
     Left fil -> putStrLn ""
     Right fir -> do
      putStrLn $ get (Tx.pack "あ") (Tx.pack "sessionId") fir
      putStrLn $ get (Tx.pack "い") (Tx.pack "sessionId") fir
    putStrLn $ getFromStr (Tx.pack "あ")
    return ()

    where
     get::Tx.Text -> Tx.Text -> Ini.Ini -> String
     get section key ini =
      case Ini.lookupValue section key ini of
       Left l -> l
       Right r -> Tx.unpack r

     getFromStr::Tx.Text -> String
     getFromStr section =
      case Ini.parseIni (Tx.pack "[あ]\nhost=localhost\nport=6666\nsessionId=ない") of
       Left il -> il
       Right ir -> get section (Tx.pack "sessionId") ir

{-# LANGUAGE ScopedTypeVariables #-}

module Main where

import qualified Data.HashMap as HM

import qualified Data.Ini as Ini

import qualified Data.Text as Tx

import Control.Exception.Safe

main::IO ()

main = do

fi < - Ini.readIniFile "test.ini"

`catch` (\(e::SomeException) -> do

putStrLn $ displayException e

return $ Ini.parseIni (Tx.pack "")

)

case fi of

Left fil -> putStrLn ""

Right fir -> do

putStrLn $ get (Tx.pack "あ") (Tx.pack "sessionId") fir

putStrLn $ get (Tx.pack "い") (Tx.pack "sessionId") fir

putStrLn $ getFromStr (Tx.pack "あ")

return ()

where

get::Tx.Text -> Tx.Text -> Ini.Ini -> String

get section key ini =

case Ini.lookupValue section key ini of

Left l -> l

Right r -> Tx.unpack r

getFromStr::Tx.Text -> String

getFromStr section =

case Ini.parseIni (Tx.pack "[あ]\nhost=localhost\nport=6666\nsessionId=ない") of

Left il -> il

Right ir -> get section (Tx.pack "sessionId") ir

[crayon-61436ef2a… 続きを読む [haskell]iniファイルとexception

[haskell][BNFC]n3337 Raw-string

n3337のRaw-stringをBNFCで定義する。

{-
Unicode:
	Unicode scalar value
		Basic Multilingual Plane(BMP) = U+0000 - U+FFFF(*)
		Supplementary Multilingual Plane = U+010000 - U+10FFFF
		*) Reserved U+D800 - U+DFFF for Surrogate Pair encode rule.

	=> char

r-char:
	Any member of the source character set, except a right parenthesis ) followed
	by the initial d-char-sequence (which may be empty) followd by a double quote.

	=> (char - [")"])

d-char:
	Any member of the basic source character set except:
	space, the left parenthesis (, the right parenthesis ), the backslash \,
	and the control characters representing horizontal tab, vertical tab,
	form feed, and newline.

	=> (basic source char - ["() \\\t\v\f\n"])

	2.3 Character sets
	The basic source character set onsists of 96 characters:
	the space character, the control characters representing horizontal tab,
	vertical tab, form feed, and new-line, plus the following 91 graphical characters:
	a-z, A-Z, 0-9 and  _{} []#() <>%:; .?*+- /^&|~ !=,\" '

	=> ["\t\v\f\n0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz_{}[]#()<>%:;.?*+-/^&|~!=,\\\"\'"]
-}
LTest. Test::= Raw_string;
token Raw_string ({"u8"} | ["uUL"])? {"R\""} (["\t\n0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz_{}[]#()<>%:;.?*+-/^&|~!=,\\\"\'"] - ["() \\\t\n"])* '(' (char - [")"])* ')' (["\t\n0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz_{}[]#()<>%:;.?*+-/^&|~!=,\\\"\'"] - ["() \\\t\n"])* '"';

Unicode:

Unicode scalar value

Basic Multilingual Plane(BMP) = U+0000 - U+FFFF(*)

Supplementary Multilingual Plane = U+010000 - U+10FFFF

*) Reserved U+D800 - U+DFFF for Surrogate Pair encode rule.

=> char

r-char:

Any member of the source character set, except a right parenthesis ) followed

by the initial d-char-sequence (which may be empty) followd by a double quote.

=> (char - [")"])

d-char:

Any member of the basic source character set except:

space, the left parenthesis (, the right parenthesis ), the backslash \,

and the control characters representing horizontal tab, vertical tab,

form feed, and newline.

=> (basic source char - ["() \\\t\v\f\n"])

2.3 Character sets

The basic source character set onsists of 96 characters:

the space character, the control characters representing horizontal tab,

vertical tab, form feed, and new-line, plus the following 91 graphical characters:

a-z, A-Z, 0-9 and _{} []#() <>%:; .?*+- /^&|~ !=,\" '

=> ["\t\v\f\n0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz_{}[]#()<>%:;.?*+-/^&|~!=,\\\"\'"]

LTest. Test::= Raw_string;

token Raw_string ({"u8"} | ["uUL"])? {"R\""} (["\t\n0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz_{}[]#()<>%:;.?*+-/^&|~!=,\\\"\'"] - ["() \\\t\n"])* '(' (char - [")"])* ')' (["\t\n0123456789ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz_{}[]#()<>%:;.?*+-/^&|~!=,\\\"\'"] - ["() \\\t\n"])* '"';

~$ ./TestRawStr 
u8R"2sS(あ)6wY"
Parse Successful!

[Abstract Syntax]

LTest (Raw_string "u8R\"2sS(\12354)6wY\"")

[Linearized tree]

u8R"2sS(あ)6wY"
~$ 
~$ ./TestRawStr 
R"^^(あああ)^^"
Parse Successful!

[Abstract Syntax]

LTest (Raw_string "R\"^^(\12354\12354\12354)^^\"")

[Linearized tree]

R"^^(あああ)^^"
~$

~$ ./TestRawStr

u8R"2sS(あ)6wY"

Parse Successful!

[Abstract Syntax]

LTest (Raw_string "u8R\"2sS(\12354)6wY\"")

[Linearized tree]

u8R"2sS(あ)6wY"

~$ ./TestRawStr

R"^^(あああ)^^"

Parse Successful!

[Abstract Syntax]

LTest (Raw_string "R\"^^(\12354\12354\12354)^^\"")

[Linearized tree]

R"^^(あああ)^^"

うまくパースしてくれているようで… 続きを読む [haskell][BNFC]n3337 Raw-string

[haskell][BNFC]Unicodeスカラ値のサロゲートペア範囲考慮

ユニコードスカラ値にはサロゲートペアのための領域0xD800-0xDFFFがあり、この範囲は文字を割り当てることがきない。このためcharの範囲からこの部分を外す。 [crayon-61436ef2a8be4606714… 続きを読む [haskell][BNFC]Unicodeスカラ値のサロゲートペア範囲考慮

[haskell]BNFCでUnicodeを扱える様にする

BNFCのcharは0〜255の文字コードしか扱えない。これをUnicodeの範囲に広げる。

$ git diff
diff --git a/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs b/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs
index 054d576..e2b744f 100644
--- a/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs
+++ b/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs
@@ -63,7 +63,7 @@ cMacros = [
   "$s = [a-z\\222-\\255] # [\\247]    -- small isolatin1 letter FIXME",
   "$d = [0-9]                -- digit",
   "$i = [$l $d _ ']          -- identifier character",
-  "$u = [\\0-\\255]          -- universal: any character"
+  "$u = [\\x0000-\\x10FFFF]          -- universal: any character"
   ]
 
 rMacros :: CF -> [String]
$

$ git diff

diff --git a/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs b/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs

index 054d576..e2b744f 100644

--- a/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs

+++ b/source/src/BNFC/Backend/Haskell/CFtoAlex3.hs

@@ -63,7 +63,7 @@ cMacros = [

"$s = [a-z\\222-\\255] # [\\247] -- small isolatin1 letter FIXME",

"$d = [0-9] -- digit",

"$i = [$l $d _ '] -- identifier character",

- "$u = [\\0-\\255] -- universal: any character"

+ "$u = [\\x0000-\\x10FFFF] -- universal: any character"

]

rMacros :: CF -> [String]

$ cat R_char.cf
LTest. Test::= R_char_sequence;
token R_char_sequence (char - [")"])+;
$

$ cat R_char.cf

LTest. Test::= R_char_sequence;

token R_char_sequence (char - [")"])+;

BNFCでUnicodeを扱える様にする

[haskell]UTF8へのencode

UTF-8へのエンコードは2種類ある。

module Main (main) where
import qualified Codec.Binary.UTF8.String as US

main = do
	s < -getContents
	print $ US.encode s
	print $ US.encodeString s

module Main (main) where

import qualified Codec.Binary.UTF8.String as US

main = do

s < -getContents

print $ US.encode s

print $ US.encodeString s

$ ./main 
あ[227,129,130]
"\227\129\130"

$ ./main

あ[227,129,130]

"\227\129\130"

[crayon-61436ef2aa601098… 続きを読む [haskell]UTF8へのencode

import Codec.Binary.UTF8.String

-- str = ["\x0041", "\x3042", "\x57CE", "\x2F852"]
str = ["A", "あ", "城", "城"]

main::IO()
main = do
        putStrLn "Haskell内部コード"
        mapM_ print str
        mapM_ putStrLn str
        putStrLn "Haskell内部コード>UTF8コード"
        mapM_ (\x -> print $ encodeString x) str
        mapM_ (\x -> putStrLn $ decodeString $ encodeString x) str

import Codec.Binary.UTF8.String

-- str = ["\x0041", "\x3042", "\x57CE", "\x2F852"]

str = ["A", "あ", "城", "城"]

main::IO()

main = do

putStrLn "Haskell内部コード"

mapM_ print str

mapM_ putStrLn str

putStrLn "Haskell内部コード>UTF8コード"

mapM_ (\x -> print $ encodeString x) str

mapM_ (\x -> putStrLn $ decodeString $ encodeString x) str

出力結果

$ ./strsmpl 
Haskell内部コード
"A"
"\12354"
"\22478"
"\194642"
A
あ
城
城
Haskell内部コード>UTF8コード
"A"
"\227\129\130"
"\229\159\142"
"\240\175\161\146"
A
あ
城
城

$ ./strsmpl

Haskell内部コード

"A"

"\12354"

"\22478"

"\194642"

あ

城

城

Haskell内部コード>UTF8コード

"A"

"\227\129\130"

"\229\159\142"

"\240\175\161\146"

あ

城

城

Haskell内部ではUnicodeスカラ値… 続きを読む [haskell]内部文字コード

[haskell]iniファイルとexception

[haskell][BNFC]n3337 Raw-string

[haskell][BNFC]Unicodeスカラ値のサロゲートペア範囲考慮

[haskell]BNFCでUnicodeを扱える様にする

[haskell]UTF8へのencode

[haskell]文字列の扱い2

[Haskell]haskellの難しいところ

[haskell]文字列の扱い

ご挨拶 – 2017年

[haskell]内部文字コード