User Tools

Site Tools


no way to compare when less than two revisions

Differences

This shows you the differences between two versions of the page.


Previous revision
Next revision
playground:mission-log-template [2016/03/18 15:40] – [Step 7: Flash original jffs2] chrono
Line 1: Line 1:
 +~~DRAFT~~
 +====== Harder Soft-Unbricking a Ubiquiti Unifi UAP-Pro AP======
  
 +Image sideview
 +
 +After re-deploying the Ubiquiti Unifi UAP-Pro at the new base-camp, it simply didn't work anymore. No DHCP reaction, nothing. Except for the LED blinking white sometimes, it seemed completely broken. After opening and attaching a terminal to the serial console, the boot output didn't look promising but at least it wasn't completely dead. So we had to get our hands dirty, pop the hood and hack around to fix this jffs2 issue and revive the AP without costly and probably long/painful RMA.
 +
 +===== The Symptom =====
 +
 +<code>
 +U-Boot unifi-v1.2.3.74-ge597862a (Mar 14 2013 - 18:30:11)
 +
 +Board: Ubiquiti Networks AR9344 board (e507-27.2122.0030.0030)
 +DRAM:  128 MB
 +Flash: 16 MB
 +Net:   eth0
 +Hit any key to stop autoboot:  0
 +Scanning JFFS2 FS: .| 
 +Unknown node type: e008 len 52 offset 0xf41eec
 +[...]                                                                                                                                       done.
 +cant find .firewall.uci-mWgTyx��
 +[...]
 +cant find .wireless.uci-HxpWh9
 +cant find .network.uci-anmaB1
 +�����������������������������������������������������������������������
 +�����������������������������������������������������������������������
 +�����������������������������������������������������������������������
 +�������������������������������������������������������
 +</code>
 +
 +It is still unclear what exactly causes this jffs2 corruption, but there have been at least three other reported cases and one directly confirmed by djs500, who found the draft-wip-template for this mission log on the net, had exactly the same problem and came back with positive feedback that he was able to fix it using Solution 3, as we did too.
 +
 +===== Solution 1 =====
 +
 +https://community.ubnt.com/t5/UniFi-Troubleshooting/UniFi-TFTP-soft-recovery-for-bricked-access-point/ta-p/607605
 +
 +
 +Set a static IP on your PC's NIC from 192.168.1.0/24 range, but not 192.168.1.20 (this is the Unifi AP default TFTP IP).
 + 
 +Follow the steps to unbrick your UAP:
 +  - Set the IP on your PC to be able to access the bricked unit and prepare the firmware file.
 +  - On your PC, open your TFTP client and locate the firmware.bin file so you can start it later. Do not initiate the transfer.
 +Using the Windows integrated TFTP client the command to prepare is: "tftp -i 192.168.1.20 PUT [path to file]\firmware.bin"
 +Unplug the bricked unit.
 +Plug the LAN connection of the PoE injector directly to your PC's NIC.
 +Keep the UniFi AP's reset button depressed and plug in network/PoE in the unit.
 +Keep the reset button depressed until you see the light cycling relatively fast through amber/green/off colors (~14 seconds from power on) -> Release it. Now the device is in TFTP transfer mode.
 +Engage the TFTP push command and wait. The device will write the firmware and it will reboot.
 +If you wait too long to start the TFTP transfer, the push will not work as the device will stall. Please redo from step 3.
 +To ensure all goes clean, after the device gets stable (blinking or steady amber LED), give it a reset:
 +Remove power. Reconnect holding the reset button for ~7 seconds (green led will flash once) -> release reset button and wait for the device to stabilize again.
 +After device is stabilized, power cycle it again, and you are good to go on adopting the device in the controller again.
 +
 +<WRAP round alert>
 +<html><p style="line-height: 40px; font-size: 26px;">
 +Official UBNT solution didn't work at all
 +</p>
 +</html> 
 +</WRAP>
 +
 +This may be due to the fact that it expects a bricked UBNT firmware and NOT an OpenWRT installation.
 +===== Solution 2 =====
 +
 +Soft Unbrick via Serial using urescue and a tftp server was another method mentioned somewhere, but sadly it never really flashed anything and went staight to the reset in less than a second instead. It could never have written the complete firmware in this short time period and after testing: it didn't, so "Firmware update complete" was a lie:
 +
 +<code>
 +ar7240> urescue
 +Setting default IP 192.168.1.20
 +Starting TFTP server...
 +Using eth0 (192.168.1.20), address: 0x81000000
 +Waiting for connection: -
 +Receiving file from 192.168.1.254:39067
 +Received 4683453 bytes
 +Firmware Version: BZ.ar934x.v3.2.1.2601.140606.1622
 +Setting U-Boot environment variables
 +Will not overwrite u-boot partition! Skipped.
 +
 +Firmware update complete.
 +
 +Resetting..
 +</code>
 +
 +<WRAP round alert>
 +<html><p style="line-height: 40px; font-size: 26px;">
 +Serial urescue didn't work at all
 +</p>
 +</html> 
 +</WRAP>
 +
 +===== Solution 3 =====
 +
 +None of the above solutions worked with our OpenWRT UAP-Pro, so we had to grab one of the original jffs2 images from a live one with original UBNT firmware, use a tftp server to transfer that jffs2 image file to the AP, unlock and erase the corrupt jffs2 image on the flash chip and eventually write the new image by hand. 
 +
 +The following unbrick trace documents these 9 easy to follow steps codec, fpletz and I took to restore the UAP to its orginal UBNT firmware with default configuration (and default ubnt login) to be able to finally reinstall OpenWRT.
 +
 +
 +==== Step 1: Preparation ====
 +
 +<WRAP round download>
 +**If you've lost your original firmware backup too, you can download the jffs2 image here: **\\
 +{{https://apollo.open-resource.org/downloads/jffs2.img.bz2|}}\\
 +</WRAP>
 +
 +Just bunzip2 the downloaded jffs2.img.bz2 and put jffs2.img into your tftproot so that the AP can access it via LAN. If you don't know which tftp-server to pick, dnsmasq and atftp have been reliable alternatives and have a solid base of documentation and HOWTOs to get started out there.
 +
 +In this setup dnsmasq with tftp enabled was hosted on a laptop, eth0 IP 192.168.1.254 connected via LAN to the main port of the UAP-Pro.
 +
 +==== Step 2: Connect Serial Console ====
 +
 +image: ttl-serial-connection-info
 +
 +==== Step 3: Transfer jffs2 image to AP ====
 +
 +Power up the AP and press a key to enter u-boot menu, then transfer and load the original
 +jffs2 image over tftp to the AP and store it in RAM, starting at memory address **0x83000000**:
 +
 +<code>
 +ar7240> tftp 83000000 jffs2.img
 +</code>
 +
 +If the tftp server is reachable, the output should look like this:
 +
 +<code>
 +Using eth0 device
 +TFTP from server 192.168.1.254; our IP address is 192.168.1.20
 +Filename 'jffs2.img'.
 +Load address: 0x83000000
 +Loading: #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #################################################################
 +         #############################
 +done
 +Bytes transferred = 16121856 (f60000 hex)
 +</code>
 +
 +The firmware image is stored in RAM now and occupies **0xf60000** bytes. Writing it from there to flash memory directly may fail when the target area has not been erased or if it is write-protected. Let's take care of that first.
 +==== Step 4: Reset partition table to defaults ====
 +
 +This gives you an overview of the partition table layout
 +
 +<code>
 +ar7240> mtdparts
 +</code>
 +
 +<code>
 +device nor0 <ath-nor0>, # parts = 5
 + #: name                        size            offset          mask_flags
 + 0: u-boot                      0x00040000      0x00000000      0
 + 1: u-boot-env                  0x00010000      0x00040000      0
 + 2: jffs2                       0x00f60000      0x00050000      0
 + 3: cfg                         0x00040000      0x00fb0000      0
 + 4: EEPROM                      0x00010000      0x00ff0000      0
 +
 +active partition: nor0,0 - (u-boot) 0x00040000 @ 0x00000000
 +
 +defaults:
 +mtdids  : nor0=ath-nor0
 +mtdparts: mtdparts=ath-nor0:256k(u-boot),64k(u-boot-env),15744k(jffs2),256k(cfg),64k(EEPROM)
 +</code>
 +
 +Reset partition table to defaults with
 +
 +<code>
 +ar7240> mtdparts default
 +</code>
 +
 +Save environment changes:
 +
 +<code>
 +ar7240> saveenv
 +</code>
 +
 +<code>
 +Saving Environment to Flash...
 +Un-Protected 1 sectors
 +Erasing Flash.... done
 +Erased 1 sectors
 +Writing to Flash... write addr: 9f040000
 +done
 +Protected 1 sectors
 +</code>
 +
 +==== Step 5: Unlock Flash-Banks ====
 +
 +Now it is time to make sure that any write-protection is disabled:
 +
 +<code>
 +ar7240> protect off all
 +</code>
 +<code>
 +Un-Protect Flash Bank # 1
 +</code>
 +
 +==== Step 6: Erase the corrupt jffs2 ====
 +
 +Figuring out the correct address and length was a bit difficult, uncertain, not well documented and took us quite a while, because we didn't want to brick it more by writing stuff somewhere other than we intended. Unfortunately, there was no documentation about the process of how we derived at that conclusion, but in the end we finally decided to start at address **0x9f050000** for the length of the jffs2 image as indicated by the tftp transfer (**0xf60000**) and the mtd partition size (**0xf60000**)
 +
 +<code>
 +ar7240> erase 0x9f050000 +0xf60000
 +</code>
 +
 +<code>
 +...................................................................................................................................................................................................................................................... done
 +Erased 246 sectors
 +</code>
 +
 +==== Step 7: Flash original jffs2 ====
 +
 +In this step we're going to copy the jffs2 image stored in RAM, starting at address **0x83000000**, and write it to the previously erased jffs2 flash area starting at address **0x9f050000** for the length of **0xf60000**. The cp command knows about flash memory areas and will automatically invoke the necessary flash programming algorithm, when the target area is in flash memory.
 +
 +<code>
 +ar7240> cp.b 0x83000000 0x9f050000 0xf60000
 +</code>
 +
 +<code>
 +Copy to Flash... write addr: 9f050000
 +done
 +</code>
 +
 +==== Step 8: Verify the jffs2 was flashed correctly ====
 +
 +Since we still have the jffs2 image stored in RAM, starting at address **0x83000000**, we can now comfortably byte-compare it with the content starting at address **0x9f050000** (Flash) for the length of **0xf60000**. Both have to match, otherwise something obviously went wrong during the flashing process.
 +
 +<code>
 +ar7240> cmp.b 0x83000000 0x9f050000 0xf60000
 +</code>
 +<code>
 +Total of 16121856 bytes were the same
 +</code>
 +
 +==== Step 9: Reset, Reinstall OpenWRT and enjoy your revival work ====
 +<code>
 +ar7240> reset
 +</code>
 +
 +<code>
 +Resetting...
 +
 +U-Boot unifi-v1.2.3.74-ge597862a (Mar 14 2013 - 18:30:11)
 +
 +Board: Ubiquiti Networks AR9344 board (e507-27.2122.0030.0030)
 +DRAM:  128 MB
 +Flash: 16 MB
 +Net:   eth0
 +Hit any key to stop autoboot:  0
 +Scanning JFFS2 FS: . done.
 +## Booting image at 81000000 ...
 +   Image Name:   MIPS Ubiquiti Linux-2.6.32.33
 +   Created:      2014-06-06  23:26:31 UTC
 +   Image Type:   MIPS Linux Kernel Image (lzma compressed)
 +   Data Size:    4450109 Bytes =  4.2 MB
 +   Load Address: 80002000
 +   Entry Point:  80002000
 +   Verifying Checksum at 0x81000040 ...OK
 +   Uncompressing Kernel Image ... OK
 +
 +Starting kernel ...
 +</code>
 +
 +{{tag>carbon hardware diy 3d-print sourcing}}
 +
 +{{keywords>Apollo-NG apollo next generation hackerspace hacker space research development makerspace fablab diy community open-resource open resource mobile hackbus hackbase carbon hardware diy 3d-print sourcing}}
 +
 +~~LINKBACK~~
 +~~DISCUSSION~~
 +
 +
 +When you are done with your draft, enter the following URL schema, create the page (with current date and your title) and copy the content into it:
 +
 +https://apollo.open-resource.org/mission:log:2013:09:24:title-of-mission-log