OpenResty
®
Color
pdf
|<<
<
>
>>|
/
OpenResty 开源世界新发展 ☺{{#author|yichun@openresty.com}}☻ {{#author|章亦春 (@agentzh)}} {{img src="images/openresty2.png" width="128" height="128"}} {{#date|2018.11}} ---- {{#x|☺}} OpenResty 1.15.6.1 即将发布 ➥ 基于最新的 NGINX 1.15.6 核心 ➥ RC0 包已公布 ---- {{#x|☺}} 官方 OpenResty {{#ci|64}} 位 Windows 二进制包 ---- {{img src="images/openresty-pkgs.png" width="723" height="850"}} ---- {{img src="images/linux-packages.png" width="795" height="850"}} ---- {{#x|☺}} 基于 cosocket 连接池的后端{{#ci|并发调控}} ➥ 溢出连接池容量的新连接请求会自动排队, 直到排队队列也溢出。 ---- {{#cm|# in nginx.conf:}} {{#cm|# read nameserver addresses from /etc/resolv.conf}} {{#kw|resolver}} local=on ipv6=off; ---- {{#kw|resolver}} local=/path/to/resolv.conf; ---- {{#x|☺}} OpenResty 的 OpenSSL {{#ci|1.1.0}} 支持 ---- {{#x|☺}} lua_shared_dict shdict:expire() shdict:ttl() shdict:free_space() shdict:capacity() ---- {{#x|☺}} OpenResty 的 {{#ci|ARM64}} (Aarch64) 支持 ---- {{#x|☺}} LuaJIT {{#x|GC64}} 支持 ➥ {{#ci|打破}} 每 worker 进程 2GB 或 4GB 的 GC 管理的内存上限 ➥ {{#ci|128}} TB 地址空间 ---- {{#x|☺}} {{#ci|取消}} 对标准 Lua 5.1 解释器的兼容支持 ➥ 要求使用 LuaJIT 2 ➥ 推荐 OpenResty 的 LuaJIT 2.1 分支 ➥ 更精简的代码树,更小内存占用 ---- {{#x|☺}} OpenResty 的 LuaJIT 2.1 分支 {{#ci|新}} 特性 ---- {{#kw|local}} clone_tab = {{#kw|require}} \"{{#c|table.clone}}\" {{#kw|local}} old_table = { dog = 3, cat = 5 } {{#kw|local}} new_table = {{#c|clone_tab}}(old_tabe) ---- {{#kw|local}} isarray = {{#kw|require}} \"{{#c|table.isarray}}\" print(isarray({1, 2, \"abc\"})) {{#cm|-- true}} print(isarray({dog = 32})) {{#cm|-- false}} print(isarray({1, 2, dog = 32})) {{#cm|-- false}} print(isarray({})) {{#cm|-- true}} ---- {{#kw|local}} isempty = {{#kw|require}} \"{{#c|table.isempty}}\" print(isempty({})) {{#cm|-- true}} print(isempty({3})) {{#cm|-- false}} ---- {{#kw|local}} nkeys = {{#kw|require}} \"{{#c|table.nkeys}}\" print(nkeys({})) {{#cm|-- 0}} print(nkeys({5, 3, 1})) {{#cm|-- 3}} print(nkeys({dog = 5, 3, cat = 1})) {{#cm|-- 3}} ---- {{#kw|local}} nkeys = {{#kw|require}} \"{{#c|table.nkeys}}\" {{#kw|local}} n = 0 {{#kw|local}} v1 = data[key1] {{#kw|if}} v1 ~= {{#kw|nil}} {{#kw|then}} n = n + 1 {{#kw|end}} {{#kw|local}} v2 = data[key2] {{#kw|if}} v2 ~= {{#kw|nil}} {{#kw|then}} n = n + 1 {{#kw|end}} ... {{#kw|local}} m = nkeys(data) {{#kw|if}} n ~= m {{#kw|then}} error(string.format(\"found %d unrecognized keys\", m - n)) {{#kw|end}} ---- {{#cm|-- Note: this is used by OpenResty internals only}} {{#kw|local}} exdata = {{#kw|require}} \"{{#c|thread.exdata}}\" exdata(0xdeadbeefLL) {{#cm|-- set the exdata of the current Lua thread}} local ptr = exdata() {{#cm|-- fetch the exdata of the current Lua thread}} ---- {{img src="images/old-closure-factory.png" width="1260" height="593"}} ---- {{img src="images/new-lua-handler.png" width="1260" height="440"}} ---- {{#x|☺}} ngx_stream_lua 模块新特性 ➥ 由 OpenResty 默认包含并启用 ---- {{#kw|stream}} { {{#kw|server}} { {{#cm|# UDP server listening on port 53}} {{#kw|listen}} 53 {{#x|udp}}; {{#kw|content_by_lua_file}} lua/my-udp-server.lua; } {{#kw|server}} { {{#cm|# TCP server listening on port 3306}} {{#kw|listen}} 3306; {{#kw|content_by_lua_file}} lua/my-tcp-server.lua; } } ---- {{#kw|server}} { {{#cm|# UDP server listening on port 53}} {{#kw|listen}} 53 {{#x|udp}}; {{#kw|content_by_lua_block}} { {{#kw|local}} udpsock, err = ngx.req.socket() {{#kw|local}} data, err = udpsock:receive() {{#kw|if not}} data {{#kw|then}} ngx.log(ngx.ERR, \"failed to receive: \", err) {{#kw|return}} {{#kw|end}} {{#kw|local}} bytes, err = updsock:send(\"received: \" .. data) } } ---- {{#x|☺}} 应用于 OpenResty Edge 2 的 {{#ci|DNS}} 服务器软件 ---- lua_add_variable init_by_lua* init_worker_by_lua* ssl_certificate_by_lua* content_by_lua* preread_by_lua* log_by_lua* balancer_by_lua* ... ---- ngx.re ngx.thread ngx.shared.DICT ngx.config ngx.socket ngx.worker ngx.sleep ngx.now ngx.md5 ... ---- {{img src="images/meta-lua.png" width="1260" height="569"}} ---- {{#x|☺}} 100% 非阻塞的 ngx.pipe API ⇒ 在 Linux 上基于 epoll + signalfd ---- {{#x|☺}} 标准 Lua API 函数 io.popen(\"cmd\") 是{{#ci|阻塞}} 的。 ---- {{img src="images/blocking-io-popen.gif" width="1366" height="462"}} ---- {{img src="images/ngx-pipe-off-cpu.gif" width="1366" height="244"}} ---- {{#kw|local}} ngx_pipe = {{#kw|require}} \"ngx.pipe\" {{#kw|local}} sh_cmd = \"sleep 0.1 && exit 2\" {{#kw|local}} proc, err = ngx_pipe.{{#c|spawn}}(sh_cmd) ---- {{#kw|local}} nbytes, err = proc:{{#x|write}}(stdin_data) {{#kw|local}} nbytes, err = proc:{{#x|write}}(more_stdin_data) ---- {{#kw|local}} data, err, partial = proc:{{#x|stdout_read_line}}() {{#kw|local}} data, err, partial = proc:{{#x|stderr_read_line}}() ---- {{#kw|local}} data, err, partial = proc:{{#x|stdout_read_bytes}}(len) {{#kw|local}} data, err, partial = proc:{{#x|stderr_read_bytes}}(len) ---- {{#kw|local}} data, err = proc:{{#x|stdout_read_any}}(len) {{#kw|local}} data, err = proc:{{#x|stderr_read_any}}(len) ---- {{#kw|local}} proc, err = ngx_pipe.{{#x|spawn}}(\"perl\", \"-e\", \"print 'hello'\") ---- {{#cm|✓}} {{#ci|全双工}} 支持 {{#cm|✓}} stdout/stderr 的{{#ci|合流}} 与{{#ci|分流}} {{#cm|✓}} {{#ci|流式}} 读写 {{#cm|✓}} 可实现比 {{#ci|Tcl/Expect}} 更强大的抽象 ---- {{#x|☺}} 我们的 OpenResty {{#c|CI}} 平台 ➥ 基于 ngx.pipe API 构建 ---- {{img src="images/ci-home.png" width="1260" height="743"}} ---- {{img src="images/ci-job-details.png" width="1228" height="850"}} ---- {{img src="images/ci-arch.png" width="1223" height="850"}} ---- {{#x|☺}} 我们自己的官方 lua-resty-{{#ci|shell}} 库 ➥ 基于 {{#ci|ngx.pipe}} API 实现 ---- {{#kw|local}} shell = {{#kw|require}} \"{{#x|resty.shell}}\" {{#kw|local}} stdin = \"hello\" {{#kw|local}} timeout = 1000 -- ms {{#kw|local}} max_size = 4096 -- byte {{#kw|local}} cmd = [[perl -e 'warn \"he\n\"; print <>']] {{#kw|local}} ok, stdout, stderr, reason, status = shell.{{#x|run}}(cmd, stdin, timeout, max_size) {{#kw|if not}} ok {{#kw|then}} error(string.format(\"failed to run cmd: exit %d: %s\", status, tostring(stderr)) {{#kw|end}} ---- {{#x|☺}} lua-resty-signal 库 ---- {{#kw|local}} resty_signal = {{#kw|require}} \"{{#c|resty.signal}}\" {{#kw|local}} pid = proc:pid() {{#kw|local}} ok, err = resty_signal.{{#c|kill}}(pid, \"TERM\") {{#kw|if not}} ok {{#kw|then}} ngx.log(ngx.ERR, \"failed to kill process of pid \", pid, \": \", err) {{#kw|return}} {{#kw|end}} ---- {{#kw|local}} resp = {{#kw|require}} \"{{#c|ngx.resp}}\" resp.{{#c|add_header}}(\"X-My-App\", \"great-app\") ---- {{#kw|local}} resp = {{#kw|require}} \"{{#c|ngx.req}}\" req.{{#c|add_header}}(\"X-My-App\", \"great-app\") ---- {{#x|☺}} lua-resty-limit {{#c|resty.limit.count}} ---- {{#x|☺}} 新版 {{#ci|opm}} 正在酝酿中…… ➥ opm.openresty.org 官网将更漂亮更强大 ➥ opm 将支持包含 C 组件的 Lua 库 ---- {{#x|☺}} 未来新的{{#ci|开源}} 组件和特性 ---- {{#x|☺}} 支持在 {{#ci|init_by_lua*}} 上下文中使用 会 {{#ci|yield}} 的 Lua API 函数 ngx.socket.tcp ngx.socket.udp ngx.sleep ngx.semaphore ngx.pipe ---- {{#x|☺}} {{#ci|Edge}} 小语言编译器的 Lua 实现和 Lua 后端 ➥ Edge 语言针对 Web {{#ci|控制}} 逻辑,是基于{{#ci|规则}} 的小语言 ---- {{#kw|uri-prefix}}(\"/forum/\"), {{#kw|uri-ext}}(\".jpg\", \".png\"); {{#kw|uri-prefix}}(\"/css/\"), {{#kw|uri-ext}}(\".css\") => {{#kw|redirect}}(uri: \"/stage\" ~ uri, code: 302) ---- Edge 语言用户手册 {{https://doc.openresty.com/en/edgelang-user-manual.html}} ---- {{img src="images/edge-admin-edit-edgelang.png" width="1260" height="730"}} ---- {{#x|☺}} {{#ci|Fan}} 语言编译器的 Lua 实现和 Lua 后端 ➥ Fan 语言是 OpenResty 的 {{#ci|Perl 6}} 方言 ---- {{img src="images/edgelang-fan-code.png" width="624" height="850"}} ---- {{#x|☺}} lua-resty-* 客户端库的大量{{#ci|自动}} 生成 ➥ 基于 {{#ci|Wire}} 线路协议描述语言 (wirelang)生成{{#ci|优化}} 代码 ---- Memcached Redis MySQL PostgreSQL MongoDB RabbitMQ Beanstalkd HTTP/2 WebSocket FTP SMTP POP3 SSH RESTful API DNS gRPC Cassandra Kafka Protobuf Capnproto ...and many more ---- {{#x|☺}} 基于 {{#ci|FFI}} 的 cosockets API ➥ {{#ci|跳过}} Lua 字符串和(大部分)cdata 对象 ---- {{#x|☺}} LuaJIT 新一代垃圾回收器 ---- {{#x|☺}} 将 OpenResty/LuaJIT 作为公共语言运行时 ➥ Perl 6 世界的 Parrot 虚拟机{{#ci|没有}} 实现的梦想 ---- php2lua py2lua ru2lua js2lua tcl2lua pl2lua ---- {{#c|☺}} 欢迎提问交流 {{#c|☻}} yichun@openresty.com