Actions
Bug #62549
openNVMe Gateway deployment will fail on Pool application is not enabled
Status:
New
Priority:
Normal
Assignee:
-
Category:
cephadm
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
Need a pre-check at the NVMe GW deployment,
- pool should have application enabled
- Deploy cluster and pool rbd2 without enabling the application.
[ceph: root@ceph-sunilkumar-78yf08-node1-installer /]# ceph osd pool create rbd2
pool 'rbd2' created
- Deploy NVMe service and notice the failure from journalctl logs
[ceph: root@ceph-sunilkumar-78yf08-node1-installer /]# ceph orch apply nvmeof rbd2 --placement "ceph-sunilkumar-78yf08-node5"
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: [2023-08-23 07:36:16.325103] accel_sw.c: 681:sw_accel_module_init: *NOTICE*: Accel framework software module initialized.
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: DEBUG:control.server:create_transport: tcp options: {"in_capsule_data_size": 8192, "max_io_qpairs_per_ctrlr": 7}
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: [2023-08-23 07:36:16.529324] tcp.c: 629:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init ***
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: ERROR:control.state:Unable to create omap: [errno 1] RADOS permission error (Failed to operate write op for oid nvmeof.None.state). Exiting!
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: INFO:control.server:Terminating SPDK...
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: INFO:control.server:Exiting the gateway process.
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: Traceback (most recent call last):
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: return _run_code(code, main_globals, None,
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: exec(code, run_globals)
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: File "/src/control/__main__.py", line 35, in <module>
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: gateway.serve()
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: File "/src/control/server.py", line 99, in serve
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: omap_state = OmapGatewayState(self.config)
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: File "/src/control/state.py", line 187, in __init__
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: self.ioctx.operate_write_op(write_op, self.omap_name)
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: File "rados.pyx", line 3654, in rados.Ioctx.operate_write_op
Aug 23 03:36:16 ceph-sunilkumar-78yf08-node5 ceph-706a9552-403f-11ee-a627-fa163e135a8a-nvmeof-rbd2-ceph-sunilkumar-78yf08-node5-zloikg[449414]: rados.PermissionError: [errno 1] RADOS permission error (Failed to operate write op for oid nvmeof.None.state)
No data to display
Actions