Professional Web Applications Themes

Incremental Load - Microsoft SQL / MS SQL Server

SQL 2K I am in the process of designing data load from server A to another server B (both SQL). Table schemas are same , I want incremental load ( ie the difference from data in server A and B and load that to database in server B). All tables has primary key. Any suggestions/links related to this will be highly appreicated Thanks Sh...

  1. #1

    Default Incremental Load

    SQL 2K

    I am in the process of designing data load from server A to another server B
    (both SQL).
    Table schemas are same , I want incremental load ( ie the difference from
    data in server A and B and load that to database in server B).
    All tables has primary key.

    Any suggestions/links related to this will be highly appreicated


    Thanks
    Sh


    Shamim Guest

  2. #2

    Default Re: Incremental Load

    Thanks Kevin for the suggestions.
    Whatz ur thoughts on differential backup everyhour on server A and restore
    that into server B.

    From ur suggestion.
    1) For new record , I can use NOT EXISTS on PK column(s)
    2) modified records, look for data change identification
    3) deleted records , use again NOT EXITS

    Will it not be time consuming joining tables with more records using NOT
    EXISTS and step 2 .

    Any advantage using differential backup and restore option ??

    Thanks
    Sh

    "Kevin" <only> wrote in message
    news:eX$phx.gbl... 
    using 
    of [/ref]
    server [/ref]
    from 
    >
    >[/ref]


    Shamim Guest

  3. #3

    Default Re: Incremental Load

    The differential back scheme is just a modification of a) log ship, meaning
    you are using backups (usually just full backups plus t-logs, but diff's
    would work too) to transfer the data changes.

    The main problem with using backups is in order to make the target database
    available for queries, you will have to run a full recovery every time - on
    a large database, this could take quite a while, and the database will be
    unavailable during the recovery every time. In certain cases you can leave
    the target database in NO_RECOVERY and be read only.


    "Shamim" <com> wrote in message
    news:%phx.gbl... 
    > using [/ref]
    PK 
    > of [/ref]
    if [/ref]
    > server [/ref]
    > from 
    > >
    > >[/ref]
    >
    >[/ref]


    Kevin Guest

  4. #4

    Default Kevin

    I have the same dilemma. Table1 and Table2 share the same
    schema. Table1 is truncated and inserted every day with
    current data from a text file(cannot use rowversion). Then
    table1 is compared with table2 containing historical data.
    I guess I have to use the brutal force method to see if
    any column has changed.

    I need help on the sql command to do the comparision.

    Louis
     
    choose your 
    direct T-SQL using 
    assuming no old 
    exists" on the PK 
    to use some sort of 
    method is seeing if 
    rowversion or a 
    accomplish. [/ref]
    A to another server [/ref]
    the difference from [/ref]
    server B). [/ref]
    appreicated 
    >
    >
    >.
    >[/ref]
    Louis Guest

Similar Threads

  1. incremental numbering
    By Enrique_Gomez@adobeforums.com in forum Adobe Illustrator Windows
    Replies: 1
    Last Post: June 19th, 02:08 PM
  2. Incremental backups?
    By Ryan Ashline in forum Linux Setup, Configuration & Administration
    Replies: 12
    Last Post: September 22nd, 12:44 PM
  3. DB2 incremental vs full back up
    By Mark A in forum IBM DB2
    Replies: 5
    Last Post: July 17th, 04:54 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139