Current time: 01-18-2017, 05:07 AM Hello There, Guest! (LoginRegister)

Post Reply 
Volume Entered Read Only Mode
01-05-2017, 09:23 PM (This post was last modified: 01-05-2017 09:28 PM by kingkool68.)
Post: #1
Volume Entered Read Only Mode
My site was humming along just fine. Tonight I noticed my site was down so I SSH'd into the server to see what was going on. Tried to restart nginx and got

[Errno 30] Read-only file system

Even trying to autocomplete paths when using cd I get bash: cannot create temp file for here-document: Read-only file system

So what needs to happen so my volume can be remounted in read-write mode?

Found this https://ask.openstack.org/en/question/79...read-only/ and this https://community.rackspace.com/products/f/25/t/7212 which seem related to my problem. Not much help in fixing it for me though.

- Russell Heimlich
http://www.russellheimlich.com
Visit this user's website Find all posts by this user
Quote this message in a reply
01-06-2017, 08:06 AM
Post: #2
RE: Volume Entered Read Only Mode
While I'm not sure what caused this, I know how to fix it. You'll need to run a filesystem check as root and then reboot.

Code:
$ sudo fsck

$ sudo reboot

Justin Lund
DreamHost Product Mgr
Find all posts by this user
Quote this message in a reply
01-06-2017, 08:09 AM (This post was last modified: 01-06-2017 08:18 AM by kingkool68.)
Post: #3
RE: Volume Entered Read Only Mode
I thought I could create a new instance with my volume attached. When I do that then I can't even SSH into the instance. I guess I'll need to start over.
Here is the log when I try and rebuild the instance with the bad volume attached:

Code:
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 4.4.0-38-generic (buildd@lgw01-58) (gcc version 5.4.0 20160609 (Ubuntu 5.4.0-6ubuntu1~16.04.2) ) #57-Ubuntu SMP Tue Sep 6 15:42:33 UTC 2016 (Ubuntu 4.4.0-38.57-generic 4.4.19)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-38-generic root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Supporting XSAVE feature 0x01: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x02: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x04: 'AVX registers'
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] x86/fpu: Using 'eager' FPU context switches.
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000003fffdfff] usable
[    0.000000] BIOS-e820: [mem 0x000000003fffe000-0x000000003fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.4 present.
[    0.000000] Hypervisor detected: KVM
[    0.000000] e820: last_pfn = 0x3fffe max_arch_pfn = 0x400000000
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WC  UC- WT  
[    0.000000] found SMP MP-table at [mem 0x000f0b50-0x000f0b5f] mapped at [ffff8800000f0b50]
[    0.000000] Scanning 1 areas for low memory corruption
[    0.000000] Using GB pages for direct mapping
[    0.000000] RAMDISK: [mem 0x36fd8000-0x377e3fff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F09A0 000014 (v00 BOCHS )
[    0.000000] ACPI: RSDT 0x000000003FFFFB89 000034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: FACP 0x000000003FFFF1C0 000074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)
[    0.000000] ACPI: DSDT 0x000000003FFFE040 001180 (v01 BOCHS  BXPCDSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: FACS 0x000000003FFFE000 000040
[    0.000000] ACPI: SSDT 0x000000003FFFF234 0008DD (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)
[    0.000000] ACPI: APIC 0x000000003FFFFB11 000078 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)
[    0.000000] ACPI: RSDT 0x000000003FFFFB89 000034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000003fffdfff]
[    0.000000] NODE_DATA(0) allocated [mem 0x3fff9000-0x3fffdfff]
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000000] kvm-clock: cpu 0, msr 0:3fff5001, primary cpu clock
[    0.000000] kvm-clock: using sched offset of 1981855017 cycles
[    0.000000] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x000000003fffdfff]
[    0.000000]   Normal   empty
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x000000003fffdfff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000003fffdfff]
[    0.000000] ACPI: PM-Timer IO Port: 0xb008
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]
[    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[    0.000000] e820: [mem 0x40000000-0xfeffbfff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on KVM
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:1 nr_node_ids:1
[    0.000000] PERCPU: Embedded 33 pages/cpu @ffff88003fc00000 s98008 r8192 d28968 u2097152
[    0.000000] KVM setup async PF for cpu 0
[    0.000000] kvm-stealtime: cpu 0, msr 3fc0d940
[    0.000000] PV qspinlock hash table entries: 256 (order: 0, 4096 bytes)
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 257927
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.4.0-38-generic root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Memory: 1004584K/1048176K available (8404K kernel code, 1283K rwdata, 3944K rodata, 1480K init, 1292K bss, 43592K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]     Build-time adjustment of leaf fanout to 64.
[    0.000000]     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=1.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=1
[    0.000000] NR_IRQS:16640 nr_irqs:256 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty1] enabled
[    0.000000] console [ttyS0] enabled
[    0.000000] tsc: Detected 2099.998 MHz processor
[    0.569120] Calibrating delay loop (skipped) preset value.. 4199.99 BogoMIPS (lpj=8399992)
[    0.570369] pid_max: default: 32768 minimum: 301
[    0.571066] ACPI: Core revision 20150930
[    0.572904] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    0.574059] Security Framework initialized
[    0.574745] Yama: becoming mindful.
[    0.575424] AppArmor: AppArmor initialized
[    0.576198] Dentry cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.577988] Inode-cache hash table entries: 65536 (order: 7, 524288 bytes)
[    0.624084] Mount-cache hash table entries: 2048 (order: 2, 16384 bytes)
[    0.625106] Mountpoint-cache hash table entries: 2048 (order: 2, 16384 bytes)
[    0.626723] Initializing cgroup subsys io
[    0.627347] Initializing cgroup subsys memory
[    0.628093] Initializing cgroup subsys devices
[    0.628891] Initializing cgroup subsys freezer
[    0.629545] Initializing cgroup subsys net_cls
[    0.630197] Initializing cgroup subsys perf_event
[    0.630873] Initializing cgroup subsys net_prio
[    0.631607] Initializing cgroup subsys hugetlb
[    0.632373] Initializing cgroup subsys pids
[    0.634028] mce: CPU supports 10 MCE banks
[    0.634792] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[    0.635662] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[    0.656810] Freeing SMP alternatives memory: 32K (ffffffff820b4000 - ffffffff820bc000)
[    0.664386] ftrace: allocating 32006 entries in 126 pages
[    0.699631] smpboot: Max logical packages: 1
[    0.700414] smpboot: APIC(0) Converting physical 0 to logical package 0
[    0.701472] x2apic enabled
[    0.702202] Switched APIC routing to physical x2apic.
[    0.703793] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.704693] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[    0.706523] Performance Events: 16-deep LBR, Broadwell events, Intel PMU driver.
[    0.709556] ... version:                2
[    0.710178] ... bit width:              48
[    0.710842] ... generic registers:      4
[    0.711472] ... value mask:             0000ffffffffffff
[    0.712297] ... max period:             000000007fffffff
[    0.713058] ... fixed-purpose events:   3
[    0.713683] ... event mask:             000000070000000f
[    0.714548] KVM setup paravirtual spinlock
[    0.717022] x86: Booted up 1 node, 1 CPUs
[    0.717673] smpboot: Total of 1 processors activated (4199.99 BogoMIPS)
[    0.719364] devtmpfs: initialized
[    0.721603] evm: security.selinux
[    0.722134] evm: security.SMACK64
[    0.722719] evm: security.SMACK64EXEC
[    0.723309] evm: security.SMACK64TRANSMUTE
[    0.724001] evm: security.SMACK64MMAP
[    0.724674] evm: security.ima
[    0.725211] evm: security.capability
[    0.726077] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.727528] pinctrl core: initialized pinctrl subsystem
[    0.728581] RTC time: 15:15:52, date: 01/06/17
[    0.729587] NET: Registered protocol family 16
[    0.730580] cpuidle: using governor ladder
[    0.731257] cpuidle: using governor menu
[    0.731939] PCCT header not found.
[    0.732570] ACPI: bus type PCI registered
[    0.733151] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.734160] PCI: Using configuration type 1 for base access
[    0.792137] ACPI: Added _OSI(Module Device)
[    0.792832] ACPI: Added _OSI(Processor Device)
[    0.793520] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.794228] ACPI: Added _OSI(Processor Aggregator Device)
[    0.796709] ACPI: Interpreter enabled
[    0.797307] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20150930/hwxface-580)
[    0.798720] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20150930/hwxface-580)
[    0.800191] ACPI: (supports S0 S3 S4 S5)
[    0.800834] ACPI: Using IOAPIC for interrupt routing
[    0.801555] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.805401] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.806172] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]
[    0.807032] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.820227] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.822332] acpiphp: Slot [3] registered
[    0.823115] acpiphp: Slot [4] registered
[    0.823935] acpiphp: Slot [5] registered
[    0.824668] acpiphp: Slot [6] registered
[    0.825326] acpiphp: Slot [7] registered
[    0.826010] acpiphp: Slot [8] registered
[    0.826726] acpiphp: Slot [9] registered
[    0.827491] acpiphp: Slot [10] registered
[    0.828176] acpiphp: Slot [11] registered
[    0.828856] acpiphp: Slot [12] registered
[    0.829469] acpiphp: Slot [13] registered
[    0.830132] acpiphp: Slot [14] registered
[    0.830795] acpiphp: Slot [15] registered
[    0.831455] acpiphp: Slot [16] registered
[    0.832140] acpiphp: Slot [17] registered
[    0.832837] acpiphp: Slot [18] registered
[    0.833460] acpiphp: Slot [19] registered
[    0.834079] acpiphp: Slot [20] registered
[    0.834702] acpiphp: Slot [21] registered
[    0.835321] acpiphp: Slot [22] registered
[    0.835959] acpiphp: Slot [23] registered
[    0.836587] acpiphp: Slot [24] registered
[    0.837216] acpiphp: Slot [25] registered
[    0.837835] acpiphp: Slot [26] registered
[    0.838446] acpiphp: Slot [27] registered
[    0.839072] acpiphp: Slot [28] registered
[    0.839722] acpiphp: Slot [29] registered
[    0.840463] acpiphp: Slot [30] registered
[    0.841082] acpiphp: Slot [31] registered
[    0.841699] PCI host bridge to bus 0000:00
[    0.842336] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.843209] pci_bus 0000:00: root bus resource [io  0x0d00-0xadff window]
[    0.844102] pci_bus 0000:00: root bus resource [io  0xae0f-0xaeff window]
[    0.845010] pci_bus 0000:00: root bus resource [io  0xaf20-0xafdf window]
[    0.845895] pci_bus 0000:00: root bus resource [io  0xafe4-0xffff window]
[    0.846826] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.847945] pci_bus 0000:00: root bus resource [mem 0x40000000-0xfebfffff window]
[    0.849102] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.855653] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io  0x01f0-0x01f7]
[    0.856711] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io  0x03f6]
[    0.857646] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io  0x0170-0x0177]
[    0.858582] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io  0x0376]
[    0.864868] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI
[    0.865920] pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB
[    0.918847] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[    0.920038] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[    0.921120] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[    0.922421] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[    0.923577] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)
[    0.924915] ACPI: Enabled 16 GPEs in block 00 to 0F
[    0.926155] vgaarb: setting as boot device: PCI:0000:00:02.0
[    0.926995] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
[    0.928198] vgaarb: loaded
[    0.928675] vgaarb: bridge control possible 0000:00:02.0
[    0.929906] SCSI subsystem initialized
[    0.930763] ACPI: bus type USB registered
[    0.931355] usbcore: registered new interface driver usbfs
[    0.932209] usbcore: registered new interface driver hub
[    0.933059] usbcore: registered new device driver usb
[    0.934001] PCI: Using ACPI for IRQ routing
[    0.935076] NetLabel: Initializing
[    0.935648] NetLabel:  domain hash size = 128
[    0.936341] NetLabel:  protocols = UNLABELED CIPSOv4
[    0.937069] NetLabel:  unlabeled traffic allowed by default
[    0.937974] amd_nb: Cannot enumerate AMD northbridges
[    0.938714] clocksource: Switched to clocksource kvm-clock
[    1.040419] AppArmor: AppArmor Filesystem Enabled
[    1.041155] pnp: PnP ACPI init
[    1.042189] pnp: PnP ACPI: found 6 devices
[    1.049585] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    1.050899] NET: Registered protocol family 2
[    1.051695] TCP established hash table entries: 8192 (order: 4, 65536 bytes)
[    1.053066] TCP bind hash table entries: 8192 (order: 5, 131072 bytes)
[    1.054038] TCP: Hash tables configured (established 8192 bind 8192)
[    1.055189] UDP hash table entries: 512 (order: 2, 16384 bytes)
[    1.056107] UDP-Lite hash table entries: 512 (order: 2, 16384 bytes)
[    1.057031] NET: Registered protocol family 1
[    1.057641] pci 0000:00:00.0: Limiting direct PCI/PCI transfers
[    1.058566] pci 0000:00:01.0: PIIX3: Enabling Passive Release
[    1.059277] pci 0000:00:01.0: Activating ISA DMA hang workarounds
[    1.060954] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11
[    1.062608] Trying to unpack rootfs image as initramfs...
[    3.385257] Freeing initrd memory: 8240K (ffff880036fd8000 - ffff8800377e4000)
[    3.389184] Scanning for low memory corruption every 60 seconds
[    3.390412] futex hash table entries: 256 (order: 2, 16384 bytes)
[    3.391346] audit: initializing netlink subsys (disabled)
[    3.392211] audit: type=2000 audit(1483715755.547:1): initialized
[    3.393415] Initialise system trusted keyring
[    3.394555] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[    3.395904] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    3.398965] zbud: loaded
[    3.399840] VFS: Disk quotas dquot_6.6.0
[    3.400588] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.401896] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    3.403066] fuse init (API version 7.23)
[    3.403926] Key type big_key registered
[    3.404578] Allocating IMA MOK and blacklist keyrings.
[    3.405678] Key type asymmetric registered
[    3.406276] Asymmetric key parser 'x509' registered
[    3.407050] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 249)
[    3.408319] io scheduler noop registered
[    3.408859] io scheduler deadline registered (default)
[    3.409708] io scheduler cfq registered
[    3.410491] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    3.411317] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    3.412554] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[    3.413763] ACPI: Power Button [PWRF]
[    3.414613] GHES: HEST is not enabled!
[    3.415585] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10
[    3.416672] virtio-pci 0000:00:03.0: virtio_pci: leaving for legacy driver
[    3.418592] virtio-pci 0000:00:04.0: virtio_pci: leaving for legacy driver
[    3.421173] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10
[    3.422190] virtio-pci 0000:00:05.0: virtio_pci: leaving for legacy driver
[    3.424769] ACPI: PCI Interrupt Link [LNKB] enabled at IRQ 11
[    3.425548] virtio-pci 0000:00:06.0: virtio_pci: leaving for legacy driver
[    3.427515] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    3.455213] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    3.483505] 00:05: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    3.486315] Linux agpgart interface v0.103
[    3.489507] brd: module loaded
[    3.491646] loop: module loaded
[    3.494208]  vda: vda1
[    3.498334]  vdb: vdb1
[    3.500476] scsi host0: ata_piix
[    3.501201] scsi host1: ata_piix
[    3.501804] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0e0 irq 14
[    3.502616] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0e8 irq 15
[    3.504030] libphy: Fixed MDIO Bus: probed
[    3.505028] tun: Universal TUN/TAP device driver, 1.6
[    3.506156] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[    3.510308] PPP generic driver version 2.4.2
[    3.511072] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    3.511980] ehci-pci: EHCI PCI platform driver
[    3.512643] ehci-platform: EHCI generic platform driver
[    3.513529] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    3.514462] ohci-pci: OHCI PCI platform driver
[    3.515180] ohci-platform: OHCI generic platform driver
[    3.515992] uhci_hcd: USB Universal Host Controller Interface driver
[    3.518097] uhci_hcd 0000:00:01.2: UHCI Host Controller
[    3.518849] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1
[    3.520087] uhci_hcd 0000:00:01.2: detected 2 ports
[    3.521041] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c080
[    3.522038] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001
[    3.522949] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    3.524132] usb usb1: Product: UHCI Host Controller
[    3.524917] usb usb1: Manufacturer: Linux 4.4.0-38-generic uhci_hcd
[    3.525950] usb usb1: SerialNumber: 0000:00:01.2
[    3.526912] hub 1-0:1.0: USB hub found
[    3.527642] hub 1-0:1.0: 2 ports detected
[    3.528543] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[    3.530513] serio: i8042 KBD port at 0x60,0x64 irq 1
[    3.531322] serio: i8042 AUX port at 0x60,0x64 irq 12
[    3.532204] mousedev: PS/2 mouse device common for all mice
[    3.533347] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[    3.535317] rtc_cmos 00:00: RTC can wake from S4
[    3.536338] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[    3.537234] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram
[    3.537969] i2c /dev entries driver
[    3.538552] device-mapper: uevent: version 1.0.3
[    3.539463] device-mapper: ioctl: 4.34.0-ioctl (2015-10-28) initialised: dm-devel@redhat.com
[    3.540780] ledtrig-cpu: registered to indicate activity on CPUs
[    3.541943] NET: Registered protocol family 10
[    3.542908] NET: Registered protocol family 17
[    3.555196] Key type dns_resolver registered
[    3.556141] microcode: CPU0 sig=0x406f1, pf=0x1, revision=0x1
[    3.557018] microcode: Microcode Update Driver: v2.01 <tigran@aivazian.fsnet.co.uk>, Peter Oruba
[    3.558453] registered taskstats version 1
[    3.559162] Loading compiled-in X.509 certificates
[    3.561110] Loaded X.509 cert 'Build time autogenerated kernel key: 8b9fe5db9540517005e475afed63f7a6645227d6'
[    3.562567] zswap: loaded using pool lzo/zbud
[    3.565492] Key type trusted registered
[    3.569121] Key type encrypted registered
[    3.569863] AppArmor: AppArmor sha1 policy hashing enabled
[    3.570652] ima: No TPM chip found, activating TPM-bypass!
[    3.571757] evm: HMAC attrs: 0x1
[    3.572593]   Magic number: 1:728:284
[    3.573281] rtc_cmos 00:00: setting system clock to 2017-01-06 15:15:55 UTC (1483715755)
[    3.574483] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    3.575573] EDD information not available.
[    3.663140] ata2.01: ATAPI: QEMU DVD-ROM, 2.0.0, max UDMA/100
[    3.664477] ata2.01: configured for MWDMA2
[    3.665504] scsi 1:0:1:0: CD-ROM            QEMU     QEMU DVD-ROM     2.0. PQ: 0 ANSI: 5
[    3.667328] sr 1:0:1:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[    3.668305] cdrom: Uniform CD-ROM driver Revision: 3.20
[    3.669443] sr 1:0:1:0: Attached scsi generic sg0 type 5
[    3.672117] Freeing unused kernel memory: 1480K (ffffffff81f42000 - ffffffff820b4000)
[    3.673337] Write protecting the kernel read-only data: 14336k
[    3.675508] Freeing unused kernel memory: 1824K (ffff880001838000 - ffff880001a00000)
[    3.677381] Freeing unused kernel memory: 152K (ffff880001dda000 - ffff880001e00000)
Loading, please wait...
starting version 229
[    3.692502] random: udevadm: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.694012] random: udevadm: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.696100] random: systemd-udevd: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.697627] random: systemd-udevd: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.699157] random: systemd-udevd: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.700626] random: systemd-udevd: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.702883] random: udevadm: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.704431] random: udevadm: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.706583] random: udevadm: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.708451] random: udevadm: uninitialized urandom read (16 bytes read, 3 bits of entropy available)
[    3.756800] virtio_net virtio0 ens3: renamed from eth0
[    3.773106] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
[    3.774908] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[    3.799115] FDC 0 is a S82078B
[    3.829634] AVX2 version of gcm_enc/dec engaged.
[    3.830359] AES CTR mode by8 optimization enabled
[    3.838849] usb 1-1: new full-speed USB device number 2 using uhci_hcd
[    4.003533] usb 1-1: New USB device found, idVendor=0627, idProduct=0001
[    4.004628] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=5
[    4.005533] usb 1-1: Product: QEMU USB Tablet
[    4.006225] usb 1-1: Manufacturer: QEMU
[    4.006946] usb 1-1: SerialNumber: 42
[    4.386830] tsc: Refined TSC clocksource calibration: 2100.049 MHz
[    4.387610] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1e455ebf1ba, max_idle_ns: 440795206594 ns
Begin: Loading essential drivers ... [    5.263206] md: linear personality registered for level -1
[    5.267845] md: multipath personality registered for level -4
[    5.272107] md: raid0 personality registered for level 0
[    5.281104] md: raid1 personality registered for level 1
[    5.354732] raid6: sse2x1   gen()  6781 MB/s
[    5.422721] raid6: sse2x1   xor()  5301 MB/s
[    5.490738] raid6: sse2x2   gen()  8723 MB/s
[    5.558770] raid6: sse2x2   xor()  5587 MB/s
[    5.626727] raid6: sse2x4   gen()  9482 MB/s
[    5.694732] raid6: sse2x4   xor()  6707 MB/s
[    5.762724] raid6: avx2x1   gen() 13449 MB/s
[    5.830723] raid6: avx2x2   gen() 15624 MB/s
[    5.898757] raid6: avx2x4   gen() 18129 MB/s
[    5.899421] raid6: using algorithm avx2x4 gen() 18129 MB/s
[    5.900290] raid6: using avx2x2 recovery algorithm
[    5.904347] xor: automatically using best checksumming function:
[    5.942718]    avx       : 23603.000 MB/sec
[    5.946347] async_tx: api initialized (async)
[    5.961944] md: raid6 personality registered for level 6
[    5.962768] md: raid5 personality registered for level 5
[    5.963464] md: raid4 personality registered for level 4
[    5.970167] md: raid10 personality registered for level 10
done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Running /scripts/local-premount ... [    6.010971] Btrfs loaded
Scanning for Btrfs filesystems
done.
Warning: fsck not present, so skipping root file system
[    6.084533] EXT4-fs (vdb1): recovery complete
[    6.085271] EXT4-fs (vdb1): mounted filesystem with ordered data mode. Opts: (null)
done.
Begin: Running /scripts/local-bottom ... done.
Begin: Running /scripts/init-bottom ... Warning: overlayroot: debug is busted
done.
[    6.523144] systemd[1]: systemd 229 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN)
[    6.525485] systemd[1]: Detected virtualization bochs.
[    6.526129] systemd[1]: Detected architecture x86-64.

Welcome to [1mUbuntu 16.04.1 LTS[0m!

[    6.552189] systemd[1]: Set hostname to <root>.
[    7.125394] systemd[1]: Created slice User and Session Slice.
[[0;32m  OK  [0m] Created slice User and Session Slice.
[    7.127581] systemd[1]: Listening on Journal Socket.
[[0;32m  OK  [0m] Listening on Journal Socket.
[    7.129273] systemd[1]: Listening on udev Kernel Socket.
[[0;32m  OK  [0m] Listening on udev Kernel Socket.
[    7.131221] systemd[1]: Reached target User and Group Name Lookups.
[[0;32m  OK  [0m] Reached target User and Group Name Lookups.
[    7.133377] systemd[1]: Listening on Journal Audit Socket.
[[0;32m  OK  [0m] Listening on Journal Audit Socket.
[    7.135707] systemd[1]: Listening on Journal Socket (/dev/log).
[[0;32m  OK  [0m] Listening on Journal Socket (/dev/log).
[    7.137669] systemd[1]: Listening on Syslog Socket.
[[0;32m  OK  [0m] Listening on Syslog Socket.
[    7.139251] systemd[1]: Reached target Swap.
[[0;32m  OK  [0m] Reached target Swap.
[    7.140814] systemd[1]: Reached target Encrypted Volumes.
[[0;32m  OK  [0m] Reached target Encrypted Volumes.
[    7.142526] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[[0;32m  OK  [0m] Set up automount Arbitrary Executab...ats File System Automount Point.
[    7.144898] systemd[1]: Listening on LVM2 metadata daemon socket.
[[0;32m  OK  [0m] Listening on LVM2 metadata daemon socket.
[    7.146792] systemd[1]: Listening on /dev/initctl Compatibility Named Pipe.
[[0;32m  OK  [0m] Listening on /dev/initctl Compatibility Named Pipe.
[    7.149196] systemd[1]: Created slice System Slice.
[[0;32m  OK  [0m] Created slice System Slice.
[    7.151556] systemd[1]: Mounting POSIX Message Queue File System...
         Mounting POSIX Message Queue File System...
[    7.154226] systemd[1]: Mounting Huge Pages File System...
         Mounting Huge Pages File System...
[    7.157675] systemd[1]: Starting Create list of required static device nodes for the current kernel...
         Starting Create list of required st... nodes for the current kernel...
[    7.163320] systemd[1]: Reached target Slices.
[[0;32m  OK  [0m] Reached target Slices.
[    7.172684] systemd[1]: Starting Uncomplicated firewall...
         Starting Uncomplicated firewall...
[    7.178935] systemd[1]: Created slice system-serial\x2dgetty.slice.
[[0;32m  OK  [0m] Created slice system-serial\x2dgetty.slice.
[    7.184979] systemd[1]: Starting Journal Service...
         Starting Journal Service...
[    7.188059] systemd[1]: Starting Set console keymap...
         Starting Set console keymap...
[    7.191860] systemd[1]: Listening on udev Control Socket.
[[0;32m  OK  [0m] Listening on udev Control Socket.
[    7.196551] systemd[1]: Listening on LVM2 poll daemon socket.
[[0;32m  OK  [0m] Listening on LVM2 poll daemon socket.
[    7.200950] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[[0;32m  OK  [0m] Started Forward Password Requests to Wall Directory Watch.
[    7.209813] systemd[1]: Starting Load Kernel Modules...
         Starting Load Kernel Modules...
[    7.213249] systemd[1]: Starting Nameserver information manager...
         Starting Nameserver information manager...
[    7.222406] systemd[1]: Mounting Debug File System...
         Mounting Debug File System...
[    7.279707] systemd[1]: Starting Remount Root and Kernel File Systems...
         Starting Remount Root and Kernel File Systems...
[    7.310575] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[[0;32m  OK  [0m] Listening on Device-mapper event daemon FIFOs.
[    7.316616] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling...
         Starting Monitoring of LVM2 mirrors... dmeventd or progress polling...[    7.321918] EXT4-fs (vdb1): Couldn't remount RDWR because of unprocessed orphan inode list.  Please umount/remount instead

[    7.326030] systemd[1]: Mounted Debug File System.
[[0;32m  OK  [0m] Mounted Debug File System.
[    7.327626] systemd[1]: Mounted POSIX Message Queue File System.
[[0;32m  OK  [0m] Mounted POSIX Message Queue File System.
[    7.335594] systemd[1]: Mounted Huge Pages File System.
[[0;32m  OK  [0m] Mounted Huge Pages File System.
[    7.338855] systemd[1]: Started Create list of required static device nodes for the current kernel.
[[0;32m  OK  [0m] Started Create list of required sta...ce nodes for the current kernel.
[    7.344455] Loading iSCSI transport class v2.0-870.
[    7.346590] systemd[1]: Started Uncomplicated firewall.
[[0;32m  OK  [0m] Started Uncomplicated firewall.
[    7.415331] iscsi: registered transport (tcp)
[    7.460263] systemd[1]: Started Journal Service.
[[0;32m  OK  [0m] Started Journal Service.
[[0;1;31mFAILED[0m] Failed to start Remount Root and Kernel File Systems.
See 'systemctl status systemd-remount-fs.service' for details.
[[0;32m  OK  [0m] Started Nameserver information manager.
[[0;32m  OK  [0m] Started Set console keymap.
[    7.514887] iscsi: registered transport (iser)
[[0;32m  OK  [0m] Started Load Kernel Modules.
         Mounting FUSE Control File System...
         Starting Apply Kernel Variables...
[[0;32m  OK  [0m] Started LVM2 metadata daemon.
         Starting Initial cloud-init job (pre-networking)...
         Starting udev Coldplug all Devices...
         Starting Load/Save Random Seed...
         Starting Flush Journal to Persistent Storage...
         Starting Create Static Device Nodes in /dev...
[[0;32m  OK  [0m] Mounted FUSE Control File System.
[[0;32m  OK  [0m] Started Apply Kernel Variables.
[[0;32m  OK  [0m] Started Load/Save Random Seed.
[[0;32m  OK  [0m] Started Flush Journal to Persistent Storage.
[[0;32m  OK  [0m] Started udev Coldplug all Devices.
[[0;32m  OK  [0m] Started Create Static Device Nodes in /dev.
         Starting udev Kernel Device Manager...
[[0;32m  OK  [0m] Started Monitoring of LVM2 mirrors,...ng dmeventd or progress polling.
[[0;32m  OK  [0m] Started udev Kernel Device Manager.
[[0;32m  OK  [0m] Reached target Local File Systems (Pre).
[[0;32m  OK  [0m] Reached target Local File Systems.
         Starting Create Volatile Files and Directories...
         Starting Tell Plymouth To Write Out Runtime Data...
         Starting LSB: AppArmor initialization...
         Starting Set console font and keymap...
[[0;32m  OK  [0m] Started Dispatch Password Requests to Console Directory Watch.
[[0;32m  OK  [0m] Started Tell Plymouth To Write Out Runtime Data.
[[0;1;31mFAILED[0m] Failed to start Create Volatile Files and Directories.
See 'systemctl status systemd-tmpfiles-setup.service' for details.
         Starting Update UTMP about System Boot/Shutdown...
[[0;1;31mFAILED[0m] Failed to start Network Time Synchronization.
See 'systemctl status systemd-timesyncd.service' for details.
[[0;32m  OK  [0m] Reached target System Time Synchronized.
[[0;32m  OK  [0m] Stopped Network Time Synchronization.
[[0;1;31mFAILED[0m] Failed to start Network Time Synchronization.
See 'systemctl status systemd-timesyncd.service' for details.
[[0;32m  OK  [0m] Stopped Network Time Synchronization.
[[0;1;31mFAILED[0m] Failed to start Network Time Synchronization.
See 'systemctl status systemd-timesyncd.service' for details.
[[0;1;31mFAILED[0m] Failed to start Update UTMP about System Boot/Shutdown.
See 'systemctl status systemd-update-utmp.service' for details.
[[0;1;33mDEPEND[0m] Dependency failed for Update UTMP about System Runlevel Changes.
[[0;32m  OK  [0m] Stopped Network Time Synchronization.
[[0;1;31mFAILED[0m] Failed to start Network Time Synchronization.
See 'systemctl status systemd-timesyncd.service' for details.
[[0;32m  OK  [0m] Stopped Network Time Synchronization.
[[0;1;31mFAILED[0m] Failed to start Network Time Synchronization.
See 'systemctl status systemd-timesyncd.service' for details.
[[0;32m  OK  [0m] Stopped Network Time Synchronization.
[[0;1;31mFAILED[0m] Failed to start Network Time Synchronization.
See 'systemctl status systemd-timesyncd.service' for details.
[[0;1;31mFAILED[0m] Failed to start LSB: AppArmor initialization.
See 'systemctl status apparmor.service' for details.
[[0;32m  OK  [0m] Found device /dev/ttyS0.
[[0;32m  OK  [0m] Started Set console font and keymap.
[[0;32m  OK  [0m] Created slice system-getty.slice.
[[0;32m  OK  [0m] Found device Virtio network device.
[[0;32m  OK  [0m] Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.
[    9.647448] cloud-init[435]: Traceback (most recent call last):
[    9.666202] cloud-init[435]:   File "/usr/bin/cloud-init", line 9, in <module>
[    9.667902] cloud-init[435]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[    9.673469] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[    9.676203] cloud-init[435]:     get_uptime=True, func=functor, args=(name, args))
[    9.679150] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[    9.684243] cloud-init[435]:     ret = func(*args, **kwargs)
[    9.685906] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[    9.696242] cloud-init[435]:     util.ensure_dirs((data_d, link_d,))
[    9.749230] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[    9.750500] cloud-init[435]:     ensure_dir(d, mode)
[[0;1;31mFAILED[0m] Failed to start Initial cloud-init job (pre-networking).
See 'systemctl status cloud-init-local.service' for details.
[[0;32m  OK  [0m] Reached target Network (Pre).
[    9.754728] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[[0;32m  OK  [0m] Started ifup for ens3.
         Starting Raise network interfaces...
[    9.776063] cloud-init[435]:     chmod(path, mode)
[    9.780234] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[    9.788358] cloud-init[435]:     os.chmod(path, real_mode)
[    9.832204] cloud-init[435]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[    9.833427] cloud-init[435]: Error in sys.excepthook:
[    9.835308] cloud-init[435]: Traceback (most recent call last):
[    9.839781] cloud-init[435]:   File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
[    9.900075] cloud-init[435]:     os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
[    9.901070] cloud-init[435]: OSError: [Errno 30] Read-only file system: '/var/crash/_usr_bin_cloud-init.0.crash'
[    9.905229] cloud-init[435]: Original exception was:
[    9.906608] cloud-init[435]: Traceback (most recent call last):
[    9.912110] cloud-init[435]:   File "/usr/bin/cloud-init", line 9, in <module>
[    9.946745] cloud-init[435]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[    9.947911] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[    9.960170] cloud-init[435]:     get_uptime=True, func=functor, args=(name, args))
[    9.964180] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[    9.968631] cloud-init[435]:     ret = func(*args, **kwargs)
[    9.970607] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[    9.972162] cloud-init[435]:     util.ensure_dirs((data_d, link_d,))
[    9.975832] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[    9.978047] cloud-init[435]:     ensure_dir(d, mode)
[    9.979692] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[    9.982288] cloud-init[435]:     chmod(path, mode)
[    9.984405] cloud-init[435]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[    9.987810] cloud-init[435]:     os.chmod(path, real_mode)
[    9.989386] cloud-init[435]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[[0;32m  OK  [0m] Started Raise network interfaces.
         Starting Initial cloud-init job (metadata service crawler)...
[[0;32m  OK  [0m] Reached target Network.
[   10.442758] cloud-init[1058]: Traceback (most recent call last):
[   10.443946] cloud-init[1058]:   File "/usr/bin/cloud-init", line 9, in <module>
[   10.445134] cloud-init[1058]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[   10.448181] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[   10.452198] cloud-init[1058]:     get_uptime=True, func=functor, args=(name, args))
[   10.453469] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[   10.456220] cloud-init[1058]:     ret = func(*args, **kwargs)
[   10.460290] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[   10.461736] cloud-init[1058]:     util.ensure_dirs((data_d, link_d,))
[   10.462783] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[   10.468250] cloud-init[1058]:     ensure_dir(d, mode)
[   10.469291] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[   10.470687] cloud-init[1058]:     chmod(path, mode)
[   10.476285] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[   10.477636] cloud-init[1058]:     os.chmod(path, real_mode)
[   10.478678] cloud-init[1058]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[   10.479766] cloud-init[1058]: Error in sys.excepthook:
[   10.484811] cloud-init[1058]: Traceback (most recent call last):
[   10.485861] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
[   10.487488] cloud-init[1058]:     os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
[   10.492870] cloud-init[1058]: OSError: [Errno 30] Read-only file system: '/var/crash/_usr_bin_cloud-init.0.crash'
[   10.494195] cloud-init[1058]: Original exception was:
[   10.495157] cloud-init[1058]: Traceback (most recent call last):
[   10.500284] cloud-init[1058]:   File "/usr/bin/cloud-init", line 9, in <module>
[   10.501372] cloud-init[1058]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[   10.502647] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[   10.504153] cloud-init[1058]:     get_uptime=True, func=functor, args=(name, args))
[   10.508155] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[   10.509424] cloud-init[1058]:     ret = func(*args, **kwargs)
[   10.512205] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[   10.516177] cloud-init[1058]:     util.ensure_dirs((data_d, link_d,))
[   10.517457] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[   10.520136] cloud-init[1058]:     ensure_dir(d, mode)
[   10.521196] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[   10.524235] cloud-init[1058]:     chmod(path, mode)
[   10.528175] cloud-init[1058]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[   10.529239] cloud-init[1058]:     os.chmod(path, real_mode)
[   10.530064] cloud-init[1058]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[[0;1;31mFAILED[0m] Failed to start Initial cloud-init job (metadata service crawler).
See 'systemctl status cloud-init.service' for details.
[[0;32m  OK  [0m] Reached target Network is Online.
         Starting iSCSI initiator daemon (iscsid)...
[[0;32m  OK  [0m] Reached target System Initialization.
[[0;32m  OK  [0m] Started Trigger resolvconf update for networkd DNS.
[[0;32m  OK  [0m] Started Timer to automatically refresh installed snaps.
[[0;32m  OK  [0m] Listening on D-Bus System Message Bus Socket.
[[0;32m  OK  [0m] Started Clean PHP session files every 30 mins.
         Starting Socket activation for snappy daemon.
[[0;32m  OK  [0m] Started Daily Cleanup of Temporary Directories.
[[0;32m  OK  [0m] Started Daily apt activities.
[[0;32m  OK  [0m] Reached target Timers.
[[0;32m  OK  [0m] Started ACPI Events Check.
[[0;32m  OK  [0m] Reached target Paths.
[[0;1;31mFAILED[0m] Failed to listen on LXD - unix socket.
See 'systemctl status lxd.socket' for details.
[[0;1;33mDEPEND[0m] Dependency failed for LXD - container startup/shutdown.
[[0;32m  OK  [0m] Listening on ACPID Listen Socket.
[[0;32m  OK  [0m] Listening on UUID daemon activation socket.
[[0;32m  OK  [0m] Reached target Cloud-config availability.
[[0;32m  OK  [0m] Listening on Socket activation for snappy daemon.
[[0;32m  OK  [0m] Reached target Sockets.
[[0;32m  OK  [0m] Reached target Basic System.
         Starting Daily apt activities...
         Starting The PHP 7.0 FastCGI Process Manager...
         Starting System Logging Service...
[[0;32m  OK  [0m] Started Deferred execution scheduler.
         Starting MariaDB database server...
[[0;32m  OK  [0m] Started Regular background program processing daemon.
[[0;32m  OK  [0m] Started Snappy daemon.
         Starting Login Service...
[[0;32m  OK  [0m] Started FUSE filesystem for LXC.
         Starting The PHP 5.6 FastCGI Process Manager...
[[0;1;31mFAILED[0m] Failed to start Clean php session files.
See 'systemctl status phpsessionclean.service' for details.
         Starting Advanced key-value store...
         Starting LSB: MD monitoring daemon...
         Starting Apply the settings specified in cloud-config...
         Starting OpenBSD Secure Shell server...
         Starting LSB: Record successful boot for GRUB...
[[0;32m  OK  [0m] Started D-Bus System Message Bus.
         Starting Accounts Service...
         Starting A high performance web server and a reverse proxy server...
         Starting /etc/rc.local Compatibility...
[[0;32m  OK  [0m] Started ACPI event daemon.
[[0;32m  OK  [0m] Started memcached daemon.
         Starting Auto import assertions from block devices...
[[0;32m  OK  [0m] Started iSCSI initiator daemon (iscsid).
[[0;1;31mFAILED[0m] Failed to start MariaDB database server.
See 'systemctl status mariadb.service' for details.
[[0;1;31mFAILED[0m] Failed to start Advanced key-value store.
See 'systemctl status redis-server.service' for details.
[[0;32m  OK  [0m] Started /etc/rc.local Compatibility.
[[0;32m  OK  [0m] Started Auto import assertions from block devices.
[[0;32m  OK  [0m] Stopped Advanced key-value store.
         Starting Advanced key-value store...
         Starting Login to default iSCSI targets...
[[0;32m  OK  [0m] Started Login Service.
[[0;32m  OK  [0m] Started LSB: Record successful boot for GRUB.
[[0;32m  OK  [0m] Started Login to default iSCSI targets.
[[0;32m  OK  [0m] Reached target Remote File Systems (Pre).
[[0;32m  OK  [0m] Reached target Remote File Systems.
         Starting LSB: automatic crash report generation...
         Starting LSB: Postfix Mail Transport Agent...
         Starting Permit User Sessions...
         Starting LSB: Set the CPU Frequency Scaling governor to "ondemand"...
         Starting LSB: daemon to balance interrupts for SMP systems...
[[0;32m  OK  [0m] Started Permit User Sessions.
[[0;32m  OK  [0m] Started LSB: MD monitoring daemon.
[[0;32m  OK  [0m] Started OpenBSD Secure Shell server.
         Starting Terminate Plymouth Boot Screen...
         Starting Hold until boot process finishes up...
[[0;32m  OK  [0m] Started Terminate Plymouth Boot Screen.
[[0;32m  OK  [0m] Started Hold until boot process finishes up.
[[0;32m  OK  [0m] Started Getty on tty1.
[[0;32m  OK  [0m] Started Serial Getty on ttyS0.
[[0;32m  OK  [0m] Reached target Login Prompts.
         Starting Set console scheme...
[[0;32m  OK  [0m] Started Set console scheme.
[[0;32m  OK  [0m] Started LSB: Set the CPU Frequency Scaling governor to "ondemand".
[[0;32m  OK  [0m] Started LSB: automatic crash report generation.
[[0;1;31mFAILED[0m] Failed to start Advanced key-value store.
See 'systemctl status redis-server.service' for details.
[[0;32m  OK  [0m] Started LSB: daemon to balance interrupts for SMP systems.
         Starting Authenticate and Authorize Users to Run Privileged Tasks...
[[0;32m  OK  [0m] Stopped Advanced key-value store.
         Starting Advanced key-value store...
[[0;32m  OK  [0m] Started Authenticate and Authorize Users to Run Privileged Tasks.
[[0;32m  OK  [0m] Started Accounts Service.
[[0;1;31mFAILED[0m] Failed to start Advanced key-value store.
See 'systemctl status redis-server.service' for details.
[[0;32m  OK  [0m] Stopped Advanced key-value store.
         Starting Advanced key-value store...
[[0;1;31mFAILED[0m] Failed to start LSB: Postfix Mail Transport Agent.
See 'systemctl status postfix.service' for details.
[[0;1;33mDEPEND[0m] Dependency failed for Mail Transport Agent.
[[0;1;31mFAILED[0m] Failed to start A high performance ...rver and a reverse proxy server.
See 'systemctl status nginx.service' for details.
[[0;1;31mFAILED[0m] Failed to start Advanced key-value store.
See 'systemctl status redis-server.service' for details.
[[0;32m  OK  [0m] Stopped Advanced key-value store.
         Starting Advanced key-value store...
[[0;1;31mFAILED[0m] Failed to start Advanced key-value store.
See 'systemctl status redis-server.service' for details.
[[0;32m  OK  [0m] Stopped Advanced key-value store.
[[0;1;31mFAILED[0m] Failed to start Advanced key-value store.
See 'systemctl status redis-server.service' for details.
[   13.476990] cloud-init[1113]: Traceback (most recent call last):
[   13.478337] cloud-init[1113]:   File "/usr/bin/cloud-init", line 9, in <module>
[   13.479447] cloud-init[1113]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[   13.484308] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[   13.485646] cloud-init[1113]:     get_uptime=True, func=functor, args=(name, args))
[   13.486678] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[   13.492158] cloud-init[1113]:     ret = func(*args, **kwargs)
[   13.493003] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[   13.494394] cloud-init[1113]:     util.ensure_dirs((data_d, link_d,))
[   13.495353] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[   13.500446] cloud-init[1113]:     ensure_dir(d, mode)
[   13.501599] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[   13.502909] cloud-init[1113]:     chmod(path, mode)
[   13.507937] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[   13.509398] cloud-init[1113]:     os.chmod(path, real_mode)
[   13.510318] cloud-init[1113]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[   13.511485] cloud-init[1113]: Error in sys.excepthook:
[   13.516427] cloud-init[1113]: Traceback (most recent call last):
[   13.517446] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
[   13.518755] cloud-init[1113]:     os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
[   13.524202] cloud-init[1113]: OSError: [Errno 30] Read-only file system: '/var/crash/_usr_bin_cloud-init.0.crash'
[   13.525466] cloud-init[1113]: Original exception was:
[   13.526406] cloud-init[1113]: Traceback (most recent call last):
[   13.527537] cloud-init[1113]:   File "/usr/bin/cloud-init", line 9, in <module>
[   13.532194] cloud-init[1113]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[   13.533514] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[   13.534780] cloud-init[1113]:     get_uptime=True, func=functor, args=(name, args))
[   13.540208] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[   13.541680] cloud-init[1113]:     ret = func(*args, **kwargs)
[   13.542707] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[   13.548207] cloud-init[1113]:     util.ensure_dirs((data_d, link_d,))
[   13.549443] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[   13.550632] cloud-init[1113]:     ensure_dir(d, mode)
[   13.551499] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[   13.557020] cloud-init[1113]:     chmod(path, mode)
[   13.558095] cloud-init[1113]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[   13.559364] cloud-init[1113]:     os.chmod(path, real_mode)[[0;1;31mFAILED[0m] Failed to start Apply the settings specified in cloud-config.
See 'systemctl status cloud-config.service' for details.

[   13.562774] cloud-init[1113]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[[0;32m  OK  [0m] Stopped MariaDB database server.
         Starting MariaDB database server...
[[0;1;31mFAILED[0m] Failed to start MariaDB database server.
See 'systemctl status mariadb.service' for details.

Ubuntu 16.04.1 LTS root ttyS0

root login: [   33.525168] cloud-init[1381]: Traceback (most recent call last):
[   33.526326] cloud-init[1381]:   File "/usr/bin/cloud-init", line 9, in <module>
[   33.527265] cloud-init[1381]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[   33.532465] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[   33.533736] cloud-init[1381]:     get_uptime=True, func=functor, args=(name, args))
[   33.534762] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[   33.535842] cloud-init[1381]:     ret = func(*args, **kwargs)
[   33.540757] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[   33.541934] cloud-init[1381]:     util.ensure_dirs((data_d, link_d,))
[   33.542785] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[   33.548082] cloud-init[1381]:     ensure_dir(d, mode)
[   33.549053] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[   33.550281] cloud-init[1381]:     chmod(path, mode)
[   33.551079] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[   33.552194] cloud-init[1381]:     os.chmod(path, real_mode)
[   33.556055] cloud-init[1381]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'
[   33.557291] cloud-init[1381]: Error in sys.excepthook:
[   33.558034] cloud-init[1381]: Traceback (most recent call last):
[   33.560032] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/apport_python_hook.py", line 145, in apport_excepthook
[   33.564036] cloud-init[1381]:     os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o640), 'wb') as f:
[   33.565046] cloud-init[1381]: OSError: [Errno 30] Read-only file system: '/var/crash/_usr_bin_cloud-init.0.crash'
[   33.568027] cloud-init[1381]: Original exception was:
[   33.568986] cloud-init[1381]: Traceback (most recent call last):
[   33.572059] cloud-init[1381]:   File "/usr/bin/cloud-init", line 9, in <module>
[   33.573101] cloud-init[1381]:     load_entry_point('cloud-init==0.7.8', 'console_scripts', 'cloud-init')()
[   33.576070] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 693, in main
[   33.577278] cloud-init[1381]:     get_uptime=True, func=functor, args=(name, args))
[   33.580041] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2167, in log_time
[   33.584047] cloud-init[1381]:     ret = func(*args, **kwargs)
[   33.585033] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/cmd/main.py", line 478, in status_wrapper
[   33.588045] cloud-init[1381]:     util.ensure_dirs((data_d, link_d,))
[   33.588833] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1461, in ensure_dirs
[   33.592024] cloud-init[1381]:     ensure_dir(d, mode)
[   33.596039] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1500, in ensure_dir
[   33.597198] cloud-init[1381]:     chmod(path, mode)
[   33.597954] cloud-init[1381]:   File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 1718, in chmod
[   33.598914] cloud-init[1381]:     os.chmod(path, real_mode)
[   33.604031] cloud-init[1381]: OSError: [Errno 30] Read-only file system: '/var/lib/cloud/data'

- Russell Heimlich
http://www.russellheimlich.com
Visit this user's website Find all posts by this user
Quote this message in a reply
01-07-2017, 10:05 AM (This post was last modified: 01-07-2017 10:11 AM by mukarram.)
Post: #4
RE: Volume Entered Read Only Mode
I thought it was just me but this thread suggests otherwise. Exactly same thing happened to my volume last night .. This fixed it for me (vda1 is my partition with ext4 filesystem).

Code:
sudo fsck.ext4 -f /dev/vda1

Dear Dreamhost team, I thought you guys were done experimenting with your new cluster. What happened here?
Find all posts by this user
Quote this message in a reply
01-08-2017, 11:32 PM
Post: #5
RE: Volume Entered Read Only Mode
Oh good, it wasn't just me. Thanks for the code snippit. I'll know what to do now in the future. Instead it was easy enough for me to just rebuild my server. Not that big of a deal.

- Russell Heimlich
http://www.russellheimlich.com
Visit this user's website Find all posts by this user
Quote this message in a reply
01-09-2017, 11:53 AM
Post: #6
RE: Volume Entered Read Only Mode
(01-07-2017 10:05 AM)mukarram Wrote:  Dear Dreamhost team, I thought you guys were done experimenting with your new cluster. What happened here?

I can assure you that any issues are not results of experiments Smile The root cause was a specific operation timeout set in the Ceph cluster to mitigate the effects of a bug. This timeout was not creating troubles until the cluster suffered extended lost network connectivity in some machines. Some customers were affected in the form of filesystem corruption, and those have been handled on a case-by-case basis

DreamHost and Ceph engineers found the solution to this issue and modified the Ceph cluster to avoid this issue to happen again.

If you can't fix your volumes yourself please open a ticket and Support will do it for you.
Find all posts by this user
Quote this message in a reply
01-09-2017, 12:02 PM
Post: #7
RE: Volume Entered Read Only Mode
(01-09-2017 11:53 AM)smaffulli Wrote:  If you can't fix your volumes yourself please open a ticket and Support will do it for you.

I did but I got impatient. I'm really good at setting up my little server from scratch now and my back ups work. So it's not all bad Smile

- Russell Heimlich
http://www.russellheimlich.com
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump: