[Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

classic Classic list List threaded Threaded
14 messages Options
Reply | Threaded
Open this post in threaded view
|

[Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Don Hoover
I am still testing with RHEL6.1 here to get a working mondoarchive/recovery going.

1) Using the latest test versions (20110726001039), but also getting this same behavior with the current regular release 2.2.9.7-1 as well.
2) Working around the max_loops issue
3) Working around the extra "fi" in /usr/sbin/mindi

So just when I think I have gotten around most of the major issues and have it 'almost' working....THEN I noticed that when I restore my system it turns out is trashed and unusable with 'superblock' errors on some LV's.

What I see is that something is going wrong with the latest version and the LV's.

I noticed THIS when I poked around in the shell after the restore was completed and I ran mount to see what the restore ISO was doing:

/dev/mapper/vg00-lv_root on /mnt/RESTORING type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
/dev/mapper/vg00-lv_swap on /mnt/RESTORING/home type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
/dev/mapper/vg00-lv_usr on /mnt/RESTORING/opt type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
/dev/mapper/vg00-lv_home on /mnt/RESTORING/tmp type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
/dev/mapper/vg00-lv_var on /mnt/RESTORING/usr type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
/dev/mapper/vg00-lv_tmp on /mnt/RESTORING/var type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)


Notice anything wrong?  This might point to why my systems are unusable with "bad superblock" errors when they are booted after restore.  Everytime I do a restore and reboot the first time, it fails on lv_opt(WHICH you notice is not there in the mounted list), but is mentioned in the mondorestore.log several times.   I checked and yes, the data from /home is being restored to lv_swap, the data from /usr is being restore to lv_var etc..

Something seems to be going wrong with lv_opt and its causing this other confusion later on during the restore process.

You can see its confused, the logs seem to refer to lv_opt as being dm-2, while its really dm-1.

# cat /tmp/mountlist.txt
/dev/sda2       lvm             lvm             25701376                       

/dev/dm-0       /               ext4            2048000                        
/dev/sda1       /boot           ext4            513024          4848f99f-d9d8-4b77-9338-a401753f216b
/dev/dm-6       /home           ext4            3084288                        
/dev/dm-2       /opt            ext4            2048000                        
/dev/dm-5       /tmp            ext4            102400                         
/dev/dm-3       /usr            ext4            2048000                        
/dev/dm-4       /var            ext4            512000                         
/dev/dm-1       swap            swap            1024000              


# ls -l /dev/vg00
lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_home -> ../dm-5

lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_opt -> ../dm-1
lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_root -> ../dm-0
lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_swap -> ../dm-6
lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_tmp -> ../dm-4
lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_usr -> ../dm-2
lrwxrwxrwx    1 root     root             7 Aug  2 15:46 lv_var -> ../dm-3



I have attached the mondorestore.log from the restore, along with the original mondoarchive.log and mindi.log files from the backup.

Maybe something will pop out from the logs.

Thanks!
Don
------------------------------------------------------------------------------
BlackBerry® DevCon Americas, Oct. 18-20, San Francisco, CA
The must-attend event for mobile developers. Connect with experts.
Get tools for creating Super Apps. See the latest technologies.
Sessions, hands-on labs, demos & much more. Register early & save!
http://p.sf.net/sfu/rim-blackberry-1
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel

mindi.log.gz (26K) Download Attachment
mondoarchive.log.gz (43K) Download Attachment
mondofdisk.log.gz (90 bytes) Download Attachment
mondorestore.log.gz (34K) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Bruno Cornec-2
Hello,

Sorry for the late answer, only had time to look at it over the
week-end.

Don Hoover said on Tue, Aug 02, 2011 at 09:56:47AM -0700:

> I am still testing with RHEL6.1 here to get a working mondoarchive/recovery going.
> 1) Using the latest test versions (20110726001039), but also getting this same behavior with the current regular release 2.2.9.7-1 as well.
> 2) Working around the max_loops issue
> 3) Working around the extra "fi" in /usr/sbin/mindi
>
> So just when I think I have gotten around most of the major issues and have it 'almost' working....THEN I noticed that when I restore my system it turns out is trashed and unusable with 'superblock' errors on some LV's.
>
> What I see is that something is going wrong with the latest version and the LV's.
>
> I noticed THIS when I poked around in the shell after the restore was completed and I ran mount to see what the restore ISO was doing:
>
> /dev/mapper/vg00-lv_swap on /mnt/RESTORING/home type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
>
> Something seems to be going wrong with lv_opt and its causing this other confusion later on during the restore process.
> You can see its confused, the logs seem to refer to lv_opt as being dm-2, while its really dm-1.

Yep. Saw that indeed.

> # cat /tmp/mountlist.txt
> /dev/sda2       lvm             lvm             25701376                       
> /dev/dm-0       /               ext4            2048000                        
> /dev/sda1       /boot           ext4            513024          4848f99f-d9d8-4b77-9338-a401753f216b
> /dev/dm-6       /home           ext4            3084288                        
> /dev/dm-2       /opt            ext4            2048000                        
> /dev/dm-5       /tmp            ext4            102400                         
> /dev/dm-3       /usr            ext4            2048000                        
> /dev/dm-4       /var            ext4            512000                         
> /dev/dm-1       swap            swap            1024000              

could you run:

mindi --readalllink /dev/vg00/lv_opt and give that result
then
sh -x mindi --readalllink /dev/vg00/lv_opt 2>&1 > /tmp/res1 and send
that file
then
sh -x /usr/lib*/mindi/analyze-my-lvm 2>&1 > /tmp/res2 and send
that file so that I understand where the problem is.

Bruno.
--
Open Source & Linux Profession Lead EMEA           / http://opensource.hp.com
HP/Intel/Red Hat Open Source Solutions Initiative  / http://www.hpintelco.net
http://www.HyPer-Linux.org  http://mondorescue.org http://project-builder.org
La musique ancienne?  http://www.musique-ancienne.org http://www.medieval.org

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure contains a
definitive record of customers, application performance, security
threats, fraudulent activity and more. Splunk takes this data and makes
sense of it. Business sense. IT sense. Common sense.
http://p.sf.net/sfu/splunk-d2dcopy1
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Sebastian Trebitz
Hi all,

I confirm having the same issue on other RHEL 6.1 machines.
Attached are the information you requested for troubleshooting.


Best regards,
Sebastian

On Tue, 2011-09-20 at 01:55 +0200, Bruno Cornec wrote:

> Hello,
>
> Sorry for the late answer, only had time to look at it over the
> week-end.
>
> Don Hoover said on Tue, Aug 02, 2011 at 09:56:47AM -0700:
>
> > I am still testing with RHEL6.1 here to get a working mondoarchive/recovery going.
> > 1) Using the latest test versions (20110726001039), but also getting this same behavior with the current regular release 2.2.9.7-1 as well.
> > 2) Working around the max_loops issue
> > 3) Working around the extra "fi" in /usr/sbin/mindi
> >
> > So just when I think I have gotten around most of the major issues and have it 'almost' working....THEN I noticed that when I restore my system it turns out is trashed and unusable with 'superblock' errors on some LV's.
> >
> > What I see is that something is going wrong with the latest version and the LV's.
> >
> > I noticed THIS when I poked around in the shell after the restore was completed and I ran mount to see what the restore ISO was doing:
> >
> > /dev/mapper/vg00-lv_swap on /mnt/RESTORING/home type ext4 (rw,relatime,user_xattr,acl,barrier=1,data=ordered)
> >
> > Something seems to be going wrong with lv_opt and its causing this other confusion later on during the restore process.
> > You can see its confused, the logs seem to refer to lv_opt as being dm-2, while its really dm-1.
>
> Yep. Saw that indeed.
>
> > # cat /tmp/mountlist.txt
> > /dev/sda2       lvm             lvm             25701376                      
> > /dev/dm-0       /               ext4            2048000                        
> > /dev/sda1       /boot           ext4            513024          4848f99f-d9d8-4b77-9338-a401753f216b
> > /dev/dm-6       /home           ext4            3084288                        
> > /dev/dm-2       /opt            ext4            2048000                        
> > /dev/dm-5       /tmp            ext4            102400                        
> > /dev/dm-3       /usr            ext4            2048000                        
> > /dev/dm-4       /var            ext4            512000                        
> > /dev/dm-1       swap            swap            1024000              
>
> could you run:
>
> mindi --readalllink /dev/vg00/lv_opt and give that result
> then
> sh -x mindi --readalllink /dev/vg00/lv_opt 2>&1 > /tmp/res1 and send
> that file
> then
> sh -x /usr/lib*/mindi/analyze-my-lvm 2>&1 > /tmp/res2 and send
> that file so that I understand where the problem is.
>
> Bruno.

------------------------------------------------------------------------------
The demand for IT networking professionals continues to grow, and the
demand for specialized networking skills is growing even more rapidly.
Take a complimentary Learning@Cisco Self-Assessment and learn
about Cisco certifications, training, and career opportunities.
http://p.sf.net/sfu/cisco-dev2dev
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel

analyze.txt (71K) Download Attachment
readalllink.txt (23K) Download Attachment
signature.asc (853 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

jacuerro
Hi Everyone,

Did you find any solution for this problem?
I'm also having same problems with devicemapper on rhel 6.

Regards,
Jacek
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Bruno Cornec-2
jacuerro said on Mon, Nov 28, 2011 at 03:23:57AM -0800:

> Did you find any solution for this problem?
> I'm also having same problems with devicemapper on rhel 6.

Could you test with the current test version please ?
ftp://ftp.mondorescue.org/test/rhel/6

Bruno.
--
Open Source & Linux Profession Lead EMEA         http://opensource.hp.com
EMEA Open Source HPISC Chief Technologist        http://hpintelco.net
FLOSS projects:     http://mondorescue.org     http://project-builder.org 
Musique ancienne? http://www.musique-ancienne.org http://www.medieval.org

------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
This post was updated on .
CONTENTS DELETED
The author has deleted this message.
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
This post has NOT been accepted by the mailing list yet.
Hello Bruno,

I just found the new rpms (mondo 3.0.3) under the /test dir on your ftp site, will download and install and let you know how it goes...thanks again
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
Hello,

Installed new test version 3.0.3 mondo and new mindi from test dir...now, when the recovery starts, it does not mount any lvm devices, the install eventually fais with out of memory messages...no lvm partitions are present.
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Gattegno, Victor (GSD CSC / GCC)
Hi,

There are two test versions in
ftp://ftp.mondorescue.org/test/rhel/6/x86_64

Did you tried the latest ( 320121120171707 ) version ?

Post also your mondoarchive and mondorestore log files.

Rgds,
Victor

-----Original Message-----
From: banderson [mailto:[hidden email]]
Sent: jeudi 6 décembre 2012 04:39
To: [hidden email]
Subject: Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Hello,

Installed new test version 3.0.3 mondo and new mindi from test dir...now,
when the recovery starts, it does not mount any lvm devices, the install
eventually fais with out of memory messages...no lvm partitions are present.



--
View this message in context: http://mondorescue-mailing-list.679749.n3.nabble.com/Mondo-devel-Restore-on-RHEL6-1-messing-up-LVs-and-filesystems-tp3219541p4025454.html
Sent from the MondoRescue Mailing List mailing list archive at Nabble.com.

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
hello,

There are two test versions in
ftp://ftp.mondorescue.org/test/rhel/6/x86_64

Did you tried the latest ( 320121120171707 ) version ?

yes, that is the latest one dated 11/20

Post also your mondoarchive and mondorestore log files.

will re-run and post logs.....


Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
This post was updated on .
In reply to this post by Gattegno, Victor (GSD CSC / GCC)
Hello,

do you have a link where I can post the logs as attachments?

thanks

Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

Bruno Cornec-2
banderson said on Mon, Dec 10, 2012 at 12:53:14PM -0800:

> do you have a link where I can post the logs as attachments?

Once compressed you should be able to send them to the list. If there
are too large, then send them to me privately.

Bruno.
--
Open Source & Linux Profession Lead EMEA         http://opensource.hp.com
EMEA Open Source HPISC Chief Technologist        http://hpintelco.net
FLOSS projects:     http://mondorescue.org     http://project-builder.org 
Musique ancienne? http://www.musique-ancienne.org http://www.medieval.org

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Mondo-devel mailing list
[hidden email]
https://lists.sourceforge.net/lists/listinfo/mondo-devel
Reply | Threaded
Open this post in threaded view
|

RE: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
This post was updated on .
Hello Bruno,

here you go, I have also included some lvm info as well...all of this info with the exception of the mondoarchive.log and mindi.log was captured from the system while booted from the mondorescue image

regards


________________________________________
From: Bruno Cornec-2 [via MondoRescue Mailing List] [ml-node+s679749n4025487h55@n3.nabble.com]
Sent: Monday, December 10, 2012 4:57 PM

Subject: Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

banderson said on Mon, Dec 10, 2012 at 12:53:14PM -0800:

> do you have a link where I can post the logs as attachments?

Once compressed you should be able to send them to the list. If there
are too large, then send them to me privately.

Bruno.
--
Open Source & Linux Profession Lead EMEA         http://opensource.hp.com
EMEA Open Source HPISC Chief Technologist        http://hpintelco.net
FLOSS projects:     http://mondorescue.org     http://project-builder.org
Musique ancienne? http://www.musique-ancienne.org http://www.medieval.org

------------------------------------------------------------------------------
LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial
Remotely access PCs and mobile devices and provide instant support
Improve your efficiency, and focus on delivering more value-add services
Discover what IT Professionals Know. Rescue delivers
http://p.sf.net/sfu/logmein_12329d2d
_______________________________________________
Mondo-devel mailing list
[hidden email]</user/SendEmail.jtp?type=node&node=4025487&i=0>
https://lists.sourceforge.net/lists/listinfo/mondo-devel


________________________________
If you reply to this email, your message will be added to the discussion below:
http://mondorescue-mailing-list.679749.n3.nabble.com/Mondo-devel-Restore-on-RHEL6-1-messing-up-LVs-and-filesystems-tp3219541p4025487.html
To unsubscribe from [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems, click here<http://mondorescue-mailing-list.679749.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=3219541&code=d2lsbGlhbS5mLmFuZGVyc29uQGRlbHRhLmNvbXwzMjE5NTQxfC0zMjg3MTQwOTY=>.
NAML<http://mondorescue-mailing-list.679749.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>


mindi.log.gz (44K) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/0/mindi.log.gz>
dmidecode.out.gz (4K) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/1/dmidecode.out.gz>
ls_systemvg.out.gz (252 bytes) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/2/ls_systemvg.out.gz>
lvs.out.gz (330 bytes) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/3/lvs.out.gz>
mondoarchive.log.gz (71K) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/4/mondoarchive.log.gz>
mondofdisk.log.gz (1K) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/5/mondofdisk.log.gz>
mondorestore.log.gz (44K) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/6/mondorestore.log.gz>
mount.out.gz (490 bytes) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/7/mount.out.gz>
pvs.out.gz (152 bytes) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/8/pvs.out.gz>
uname-r.out.gz (74 bytes) <http://mondorescue-mailing-list.679749.n3.nabble.com/attachment/4025488/9/uname-r.out.gz>
Reply | Threaded
Open this post in threaded view
|

Re: [Mondo-devel] Restore on RHEL6.1 messing up LVs and filesystems

wfanders
This post was updated on .
In reply to this post by Bruno Cornec-2
Hello Bruno,

I saw that you have a new mindi and mondo rpm in the test directory.

mondo-3.0.320130104011909-0.rhel6.x86_64

mindi-2.1.420130104011909-0.rhel6.x86_64

I loaded and ran a backup, when restoring, the mountlist.txt popluated with none of the mount points, just /boot....no errors were indicated during the archive.

looks like the same issue as the previous test version. only way around it is to manuallly edit the /tmp/mountlist.txt or go interactive and add all of the lvm mount points manually

I have attached the following:



fstab.txti-want-my-lvm.txtmindi.txt.logmondoarchive.txt.logmondofdisk.txt.logmondorestore.txt.logmountlist.txt.txt

thanks again

Bill A.