font, 2D drawing on linux

Origin link 2023-4-10

 Here come several basic concept for font, drawing on linux

• DRM/KMS
• DRM/KMS is used to connect/control physical display.  It will convert pixel from memory and send it to display connector. It means if you rendering your desktop remotely( X11 forwarding, RDP), you don't need DRM/KMS.
• DRM KMS overview
• The DRM/KMS subsystem from a newbie’s point of view
• see "/sys/class/drm" for physical connector.

• font
• Anti-aliasing and subpixel rendering, see "A Closer Look At Font Rendering" for concept introduction. 
• black and white rendering is first generation rendering and print still use it.
• gray-scale rending (anti-aliasing) is second generation rendering to utilize controlling the brightness of each pixel.
• subpixel (ClearType in windows) is third generation rendering to utilize controlling pixel colors. it is for LCD on which screens, the red, green and blue subpixels that control the color and brightness of the pixel.
• Archlinux enable Anti-aliasing and subpixel by default.
• font configuration on Archlinux wiki introduce default configuration for Archlinux.
• fontconfig/freetype/pango
• Very good overview introduction: Modern text rendering with Linux: Overview
• Text Rendering Notes
• Font basic concept introduction, see CSS Fonts Module Level 3
  
  
  
  
  
• pango
• what pango is doing: "here's a piece of text render it in this box I don't care what you do." from link.
• See one pango code example: link.
• harfbuzz is text shaping engine which is incorporated into Pango .
• pango-view --font=monospace --language=zh 1.txt or pango-view --height=300 --width=100 --font=monospace --language=zh 1.txt

• fontconfig
• user guideline: fonts-conf
• pattern, element: 
• font patterns may contain essentially any properties, fontconfig use pattern to query fonts. element is which properties are listed on output
• basic syntax of pattern are: <families>-<point sizes>:<name1>=<values1>:<name2>=<values2>, see "Font Names" section of fonts-conf
• fc-list also use this pattern, see link. 
• fc-list  lists  fonts  and  styles available on the system for applications using fontconfig. if no font match query pattern, then nothing return. If wrong pattern used, then fc-list output result of "fc-list", see link. fc-list not read configuration file.
• fc-match  matches pattern (empty pattern by default) using the normal fontconfig matching rules to find the best font available.
• fc-query  queries font-file(s) using the normal fontconfig rules and prints out font pattern for each face found. fc-qury not read configuration file.
• charset
• charset is Unicode chars encoded by the font.
• charset from output of fc-list and fc-match is base85, not human-readable, see link for detai.  
• The difference Between Unicode and UTF-8, see link and link.
• Encoding translates numbers into binary. Character sets translates characters to numbers.
• Unicode is a character set. UTF-8 is encoding. 
• Unicode is a list of characters with unique decimal numbers (code points). A = 65, B = 66, C = 67, ....
• This list of decimal numbers represent the string "hello": 104 101 108 108 111
• Encoding is how these numbers are translated into binary numbers to be stored in a computer:
• UTF-8 encoding will store "hello" like this (binary): 01101000 01100101 01101100 01101100  01101111
• 4E00 is for one of CJK unicode charset, see link. 
• lang, see CSS Fonts Module Level 3 - 6.2. Language-specific display
• "lang causing a glyph change on the same codepoint given", see link. 
• No zh, but using :lang=zh-cn

• cairo
• see link. 

remote desktop on linux

Origin link 2023-4-7

• X11 forwarding, see my blog. 
• RDP
• xrdp
• this one seems only work for Xwindows, not wayland.
• Wayland
• Not all wayland application support RDP, some only support VNC.
• sway doesn't support rdp but only vnc, see link.
• weston, see link
• On the target linux device, install freerdp and weston
• pacman -S freerdp
• pacman -S weston
• On the target linux device, generate RDP certificates
• sudo mkdir -p /etc/freerdp/keys/
• sudo winpr-makecert -rdp -path /etc/freerdp/keys/
• On the target linux device, start weston
• weston --backend=rdp-backend.so --rdp-tls-cert=/etc/freerdp/keys/server.crt --rdp-tls-key=/etc/freerdp/keys/server.key
• On the windows side, start "Remote Desktop Connection" and fill in targe linux server ip.
• waypipe, see link.
• installed waypipe on both the local and remote computers
• yay -Y waypipe
• run waypipe on local linux/wsl
• waypipe ssh user@theserver weston-terminal

clash

Origin link 2023-4-5

• clash (link) 可以在linux/windows/Android上使用。它通过定义proxy group and rule来实现基于rule的traffic分发。简单的说，proxy group是proxy的集合，并可以通过type来定义怎么从一组proxy中找到一个proxy用于traffic proxy。rule就是根据ip/url把traffic mapping到不同的proxy group.
• clash configuration file is config.yaml. 各种机场需要提高相应的config.yaml for proxy group and rule. 
• 用wget下载bywa机场的订阅链接，得到的是base64 encode的ss serverlist，不是clash config.yaml。可以通过"curl -H "User-Agent: ClashForAndroid/2.0.0" <url>"得到clash config.yaml，详见link。
• 或者使用订阅转换服务，将其它订阅转换为 Clash 订阅。
• web interface
• update config.yaml
• external-controller: :9090
• # A relative path to the configuration directory or an absolute path to a
• # directory in which you put some static web resource. Clash core will then
• # serve it at `http://{{external-controller}}/ui`.
• external-ui: ui
• get clash-dashboard
• git clone https://github.com/Dreamacro/clash-dashboard.git
• cd clash-dashboard
• git checkout -b gh-pages origin/gh-pages
• ln -s clash-dashboard ui
• visit 192.168.1.4:9090/ui for control 
• clt control interface
• https://github.com/George-Miao/clashctl
• pacman -S rust
• git clone https://github.com/George-Miao/clashctl.git
• cd clashctl
• cargo install --path ./clashctl
• mv .cargo/bin/clashctl  ~/bin
• good guideline: link

X11 forwarding

Origin link 2023-4-2

 I tried to ssh to linux server (Archlinux) from wsl2 and run X-windows application on wsls. Here comes summary

• wsl2 support wslg by default, see link. You could close it by setting "guiApplications=false" in  .wslconfig  on windows side
• on linux server side
• enable "X11Forwarding yes " in /etc/ssh/sshd_config" and restart sshd.
• install xauth by "pacman -S xorg-xauth"
• on wsl2 side
• enable "ForwardX11 yes" and "ForwardX11Trusted yes" on .ssh/config
• no need to install xauth on wsl2 side
• DISPLAY variable
• host:display[.screen], for example: localhost:10.0
• see link for detail
• answer from kenorb at link gives a good summary.

rtorrent/clash/ipfs/ipv6-dhcp

Origin link 2023-4-1

• torrent
• 基本概念
• DHT
• DHT其实就是去中心化(tracker list)的p2p网络。但是DHT需要bootstrapping node做为启动节点，否则无法找到其它DHT server
• tracker list
• tracker list包含了一系列的track server。track server可以看见所有的bt node. bt node也需要tracker server发现包含下载资源的node。tracker sever一般包含在torrent种子中，也可以手动在rtorrent下载界面中添加相关tracer server。 
• rtorrent
• 基本配置可以参考rtorrent@archlinux wiki.
• 需要注意的是rtorrent无法做到server and client mode。如果rtorrent做为daemon运行，除非利用XMLRPC，否则无法通过client控制和查看daemon。所以只能通过screen实现headless运行，需要注意的是如果通过linux host远程到服务器端的rtorrent，则linux host段不能运行screeen，否则容易screen快捷键冲突。
• rtorrent的DHT需要配置才能开启，另外需要添加bootstrapping DHT server，详细配置可见 link1 and link2。
• rtorrent的配置语法有点特别。"schedule2 = watch_directory_1,10,10,"load.start=~/Download/watch_stuff1/*.torrent"中的等号后面其实是schedule2命令的参数，这里并不是给schedule2赋值。如果函数没有参数，也需要加上等号。比如"dht.statistics="
• 关键快捷键
• ctrl+x: 输入命令
• backspace/enter: 输入magnet link or torrent 
• ctrl+q: 退出rtorrent
• clash
• clash其实只是一个proxy配置应用。clash可以有效的配置每个socket request该怎么分配到不同的proxy上。
• proxy and proxy group其实就是proxy的集合，proxy group定义了该怎么选择proxy集合中的proxy。Android上clash里的proxy其实就是proxy group。
• rule定义了如何将socket request mapping到proxy/proxy-group上。rule可以根据后缀，IP等不同方式分配不同的proxy。Android上的clash可以做到不同的app走不同的proxy。
• rule provider其实其实一组rule的集合，但是它并不包含proxy target。Android clash里的Providers其实就是rule provider。
• ipfs
• ipfs其实和bitorrent都是p2p file sharing network。
• ipfs把文件分成block（树状结构），文件的CID只是根节点的hash值，并不是整个文件的hash.
• ipfs refs查看block，而不是整个文件。
• ipv6 dhcp
• ipv6 dhcp的概念和ipv4不太一样。ipv6有四种方式: Static (manual), SLAAC, Stateless DHCPv6, Stateful DCHPv6 。
• iptables防火墙需要特殊设置才能enable ipv6. default ufw has related settting.
• Following is just copy from link:
• Static (manual) address assignment – exactly like with IPv4, you can go on and apply the address yourself. I believe this is straight forward and therefore I am not going to demonstrate that.
• Stateless Address Auto Configuration (SLAAC) – nodes listen for ICMPv6 Router Advertisements (RA) messages periodically sent out by routers on the local link, or requested by the node using an RA solicitation message. They can then create a Global unicast IPv6 address by combining its interface EUI-64 (based on the MAC address on Ethernet interfaces) plus the Link Prefix obtained via the Router Advertisement. This is a unique feature only to IPv6 which provides simple “plug & play” networking. By default, SLAAC does not provide anything to the client outside of an IPv6 address and a default gateway. SLAAC is greatly discussed in RFC 4862.
• Stateless DHCPv6 – with this option SLAAC is still used to get the IP address, but DHCP is used to obtain “other” configuration options, usually things like DNS, NTP, etc. The advantage here is that the DHCP server is not required to store any dynamic state information about any individual clients. In case of large networks which has huge number of end points attached to it, implementing stateless DHCPv6 will highly reduce the number of DHCPv6 messages that are needed for address state refreshment.
• Stateful DCHPv6 – functions exactly the same as IPv4 DHCP in which hosts receive both their IPv6 address and additional parameters from the DHCP server. Like DHCP for IPv4, the components of a DHCPv6 infrastructure consist of DHCPv6 clients that request configuration, DHCPv6 servers that provide configuration, and DHCPv6 relay agents that convey messages between clients and servers when clients are on subnets that do not have a DHCPv6 server. You can learn more about DHCP for IPv6 in RFC 3315.

Regular expression

Origin link 2022-7-3

"$" are different in basic regular expression and extend regular expression, see https://stackoverflow.com/questions/38114132/why-does-dollar-not-match-literal-dollar-when-extended-regex-ere-option-is-use.

https://www.gnu.org/software/findutils/manual/html_node/find_html/posix_002degrep-regular-expression-syntax.html#posix_002degrep-regular-expression-syntax

• posix-egrep’ regular expression syntax: 
• The characters ‘^’ and ‘$’ always represent the beginning and end of a string respectively, except within square brackets. Within brackets, ‘^’ can be used to invert the membership of the character class being specified.
• ‘posix-basic’ regular expression syntax: 
  • The character ‘^’ only represents the beginning of a string when it appears:
  • At the beginning of a regular expression
  • After an open-group, signified by ‘\(’
  • After the alternation operator ‘\|’
  • The character ‘$’ only represents the end of a string when it appears:
  • At the end of a regular expression
  • Before a close-group, signified by ‘\)’
  • Before the alternation operator ‘\|’

Stack

Origin link 2022-5-14

• basic concept (from link)
• ghc only knows about packages that are installed. Installed packages live in package databases
• ghc-pkg is package tool from ghc and ghc know two database
• database is a directory, usually called package.conf.d, that contains a file for each package, together with a binary cache of the package data in the file package.cache
• global package database, which comes with your GHC installation, e.g. /usr/lib/ghc-6.12.1/package.conf.d.
• user package database private to each user, e.g. $XDG_DATA_HOME/ghc/arch-os-version/package.conf.
• LTS is may also not incomplete. 
• While we assume in general that LTS snapshots never change, there's nothing that technically prohibits that from happening. Instead, the complete version of that field is
  

  resolver:  size: 496662
    url: https://raw.githubusercontent.com/commercialhaskell/stackage-snapshots/master/lts/13/9.yaml
    sha256: 83de9017d911cf7795f19353dba4d04bd24cd40622b7567ff61fc3f7223aa3ea

• package in stack.yaml and package.yaml
• package.yaml:
• dependencies: package in LTS
• stack.yaml
• packages  : local package in local computer
• extra-deps: package from upstreams
• information in these two yaml just tells stack which packages are needed. Then stack download package and register them through ghc-pkg
• database name is decided by hash of snapshot and extra-deps
• .stack/snapshots/x86_64-linux-tinfo6/  => 02ca0c488465697d85d7ca7acaae14ad5743f138dce267e2ea1b93bd8c3bb3ab
• stack install xx will update local database and register xx package with ghc-pkg database, then these ghci could import these modules
• but database name may change if xx is new package in extra-deps
• global ghci: stack ghci out of any haskell program folder
• ~/.stack/global-project/stack.yaml
• package.yaml, cabal.project, global-project.cabal doesn't work
• stack exec (from link)
• The only issue is how to distinguish flags to be passed to stack versus those for the underlying program. Thanks to the optparse-applicative library, stack follows the Unix convention of -- to separate these, e.g.:
• stack exec --package stm -- echo I installed the stm package via --package stm
• "--package foo" can be used to force a package to be installed before running the given command

Windows

Origin link 2022-3-13

•  解决Windows10英文版中文字体难看、时大时小、中文比英文小等问题
• HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows NT\CurrentVersion\FontLink\SystemLink
• 把 MSYH.TTC,Microsoft YaHei UI,128,96 MSYH.TTC,Microsoft YaHei UI放在Segoe UI，Tahoma，Microsoft Sans Serif的前面。
• see link1, link2, link3
• chrome installation
• chrome的proxy setting用的是windows system proxy setting，而公司的新电脑上system proxy是不可以更改的。在这种情况下，安装完chrome后是无法sync and install extension。可以用google-chrome --proxy-server="socks://localhost:8080"的方式用命令行来设置chrome proxy，后就可以sync and install extension。
• 公司电脑的政策是只有whitelist里的extension是可以安装的，可以用SwitchyOmega切换proxy
• WSL
• Windows 10 21H2里的wsl (Arch)默认还是wsl1，需要在setting ->Apps & feature -> Optional features -> more windows features里安装"windows subsystem for linux" (for WSL1) and "virtual machine platform" (for WSL2)
• Arch by default is WSL1，可以先把老的ext4.vhdx改名，再把wsl1 convert to wsl2，然后再把old hvdx的文件名改回ext4.vhdx及可。
• backup for new laptop
• onedrive, outlook,edge, chrome都是cloud based的，不用特殊备份
• netid里的老证书也可以从网上下载，不用备份
• backup chrome SwitchyOmega配置, .wslconfig in $user$ folder
• WSL(arch)需要把相关文件拷贝到onedrive里，安装完成后再copy出来。
• 其它非onedriver folder backup: log

Texlive

Origin link 2022-2-19

•  Installation with pacman 
• texlive-bin
• texlive-core
• texlive-fontsextra
• texlive-formatsextra
• texlive-langchinese
• texlive-latexextra
• texlive-pictures
• 
  
• texdoc
• install
• yay texlive-most-doc
• https://bbs.archlinux.org/viewtopic.php?id=241012
• "No texlive.tlpdb nor shipped tlpdb data found"
• texdoc (user manual) use TEXMFROOT/tlpkg/texlive.tlpdb (TEXMFROOT=/usr/share) but archlinux doesn't have it
• Solution 1: install extra AUR package: yay  texlive-tlpdb
• Solution 2: use local tlpdb
• tlmgr install --with-doc xxx
• font
• mkdir font folder: .local/share/fonts/
• install Ericsson and chinese font
• ./.local/share/fonts/ericsson/EricssonHilda-Medium.ttf
• ./.local/share/fonts/ericsson/EricssonTechnicalIcons-Regular.ttf
• ./.local/share/fonts/ericsson/EricssonHilda-Regular.ttf
• ./.local/share/fonts/ericsson/EricssonCapitalTT.ttf
• ./.local/share/fonts/ericsson/EricssonHilda-Light.ttf
• ./.local/share/fonts/ericsson/EricssonHilda-Bold.ttf
• ./.local/share/fonts/windows/simhei.ttf
• ./.local/share/fonts/windows/simkai.ttf
• ./.local/share/fonts/windows/simfang.ttf
• ./.local/share/fonts/windows/simsunb.ttf
• TFM
• tex/latex/pdflatex need TFM files for all fonts.
• XeTeX and LuaTeX have no need of TFM files for TrueType and OpenType fonts which contain the necessary metrics.
• see link
• tlmgr
• set in .bashrc
• alias tlmgr='TEXMFDIST/scripts/texlive/tlmgr.pl --usermode'
• use Tsinghua mirror
• tlmgr option repository https://mirrors.tuna.tsinghua.edu.cn/CTAN/systems/texlive/tlnet
• install texlive 2021 package when texlive 2022 is released
• tlmgr option repository https://ftp.tu-chemnitz.de/pub/tug/historic/systems/texlive/2020/tlnet-final
• tlmgr install xxx
• or tlmgr install xxx --repository https://ftp.tu-chemnitz.de/pub/tug/historic/systems/texlive/2020/tlnet-final
• repository
• default: default package repository found in the installation's TeX Live Package Database (a.k.a. the TLPDB, which is given entirely in the file tlpkg/texlive.tlpdb (for example ~/texmf/tlpkg/texlive.tlpdb)
• set in command line: tlmgr option repository https://mirror.ctan.org/systems/texlive/tlnet
• set in configuration file: make a permanent change, use option repository (see the "option" action).
• correct script error
• First, edit TEXMFDIST/scripts/texlive/tlmgr.pl and replace $Master ="$Master/../.."; with $Master = "${Master}/../../..";. The path prefix TEXMFDIST is not a predefined environment variable, it is defined below in this article. Replace it with the correct value.
• system configuration
• tlmgr conf
• TEXMFCONFIG=/home/hongy19/.texlive/texmf-config
• TEXMFDBS={!!/usr/local/share/texmf:/usr/share/texmf,!!/etc/texmf,!!/var/lib/texmf,!!/usr/share/texmf-dist}
• TEXMFDIST=/usr/share/texmf-dist
• TEXMFHOME=/home/hongy19/texmf
• TEXMFLOCAL=/usr/local/share/texmf:/usr/share/texmf
• TEXMFMAIN=/usr/share/texmf-dist
• TEXMFSYSCONFIG=/etc/texmf
• TEXMFSYSVAR=/var/lib/texmf
• TEXMFVAR=/home/hongy19/.texlive/texmf-var
• error in tlmgr check file
• (base) [hongy19@CN-00000988 ~]$ tlmgr check files
  Files present but not covered (relative to /home/hongy19/texmf):
  tex/generic/pgf/tikzlibrarytimeline/tikzlibrarytimeline.code.tex
  web2c/tlmgr-commands.log
  web2c/tlmgr.log
  tlmgr.pl: An error has occurred. See above messages. Exiting.
• (base) [hongy19@CN-00000988 ~]$ pacman -Qi texlive-core
  Name            : texlive-core
  Version         : 2021.61403-1
• (base) [hongy19@CN-00000988 ~]$ tlmgr --version
  tlmgr revision 60693 (2021-10-04 04:24:25 +0200)
  tlmgr using installation: /usr/share/texmf-dist/scripts/texlive/../../..
•   --package-logfile *file* "tlmgr" logs all package actions (install, remove, update, failed updates, failed restores) to a separate log file, by default "TEXMFSYSVAR/web2c/tlmgr.log". This option allows you to specify a different file for the log.
• --command-logfile *file* "tlmgr" logs the output of all programs invoked (mktexlr, mtxrun, fmtutil, updmap) to a separate log file, by default "TEXMFSYSVAR/web2c/tlmgr-commands.log". This option allows you to specify a different file for the log.
• when tlmgr running in user mode, log is stored in TEXMFHOME/web2c, not TEXMFSYSVAR/web2c

• Kpathsea, TEXMFDBS and mktexlsr
• Kpathsea/kpsewhich use TEXINPUTS as search path
• Kpathsea/kpsewhich use ls-R database first, if no such database, it will search folder.
• ls-R database
• recommended way to create and maintain ‘ls-R’ is to run the mktexlsr
• TEXMFDBS used for ls-R
• TEXMFDBS ={!!/usr/local/share/texmf:/usr/share/texmf,!!/etc/texmf,!!/var/lib/texmf,!!/usr/share/texmf-dist}
• TEXMFDBS doesn't include TEXMFHOME which is searched for without ls-R files present.  kpsewhich could still find document in TEXMFHOME
• search document:  kpsewhich -all markdown.sty
•  TLPDB (texlive.tlpdb)
• tlpdb stands for tex live package data base, it is the main control file for the texlive package installation, it lists every package in texlive and whether you have it installed or not, which texlive mirror repository you use and lots of other details. The texlive installation seems broken if it is not there
• texlive.tlpdb on ctan is no use, the file is a local file that records which packages are installed on that machine it should be
• tlmgr init-usertree to generate texlive.tlpdb
• local texmf tree: TEXMFHOME
• https://www.ugr.es/~ftorralbo/blog/programming/local-texmf/
• mkdir /home/hongy19/texmf
• confirm TEXMFHOME path: kpsewhich -var-value=TEXMFHOME
• tlmgr init-usertree
• This creates *usertree*"/web2c" and *usertree*"/tlpkg/tlpobj", and a minimal *usertree*"/tlpkg/texlive.tlpdb".
• no need to run mktexlsr to create ls-R 
• latexmk
• copy .latexmkrc into ~
• markdown
• tlmgr install markdown
• xelatex --shell-escape markdown.tex
• add "\def\markdownOptionOutputDir{/tmp}" if Latex renders "Script file ./input.markdown.lua not found" error into pdf, see link

SSH

Origin link 2022-1-29

configuration on server side

access server

SSH2_MSG_KEX_ECDH_REPLY

old page page 2 new page