#mysql
25 October 2007
Total 27 pages. You are browsing page 27/27.
First :: Prev :: [...] [23] [24] [25] [26] [27] :: Next :: Last
23:29 <****> its not bad
23:29 <****> i have few transactions and a lot of queries
23:29 <****> sv2_: Do these child apps need to run disconnected or in geographically remote locations (and/or on potentially unreliable links) ?
23:34 <****> MarkR42 - link could go down!!
23:34 <****> In which case, there's not a lot you can do with the mysql built in tools
23:34 <****> Unless you want to build your own tool to read the child app's binlogs and somehow replay them into the master
23:35 <****> MarkR42 - i'm thinking about the mysql replication functions.. or just keeping it simple, and using a kind of cron process where i verfiy that update queries from the child to the parent are successful..
23:35 <****> Which is an option, but not something I'd do lightly as it's got a lot of scope for error
23:35 <****> MarkR42 ???
23:35 <****> one slave, even if you can guarantee that they don't overlap
23:35 <****> MarkR42 - but it can do one master.. multiple slaves...
23:36 <****> the slaves simply update back to the master..
23:36 <****> That's not what a master/slave is
23:36 <****> it's a one way xfer of data..
23:36 <****> Slaves *never* update the master, always the other way around
23:36 <****> seems no one knew the answer to my question
23:36 <****> which confirms my initial thought..
23:37 <****> ShawnRisk: #coldfusion.is.a.shitty.dead.webapp.language
23:37 <****> MarkR42 - I've been having this ongoing conversation with a collegue..
23:37 <****> yes but .cfm doesn't matter I could have put .php or anything else
23:38 <****> YOur question was coldfusion-specific and made no sense.
23:38 <****> Especially to someone who knows nothing about coldfusion. I worked in a company who used it approx 7 years ago and it was lame and out of date then
23:38 <****> MarkR42 - i'm of the opinion that it's pretty straightforward to create a process that takes a snapshot of data on the child.. and does an insert/update to the parent.. if it's successful, you timestamp it on the parent.. you then verify that the parent's child data matches the child data, and you're done..
23:39 <****> ok
23:39 <****> sv2_: Depends entirely on the nature and size of your data; taking a snapshot is something that you can't do easily on big data
23:39 <****> I don't think my question is coldfusion related at all
23:39 <****> How does it know which rows to insert/update ?
23:39 <****> this gives you complete confidence that the child data is always written to the master, and that you've got a recorded process to track the updates/inserts..
23:40 <****> sv2_: You could make a process which reads the child's binlogs and replays them into the master, e.g. with the mysqlbinlog tool
23:40 <****> on the child db/tbl, you have a colum that indicates if it's been updated/inserted into the parent..
23:40 <****> might work as well..
23:40 <****> However, this would have to be done carefully to avoid repeating events
23:41 <****> And there's the problem of what to do with errors etc
23:41 <****> what happens if you get a unique key violation?
23:42 <****> repeats are avoided by having a colum that's used for tracking when the row is inserted/written to the parent.. when a row is successfully written, it gets checked. and isn't written again..
23:42 <****> And you'd get that algorithm right in the case of a system failure at an arbitrary point in the process?
23:42 <****> I probably wouldn't.
23:42 <****> MarkR42 - don't know the exact structure of the tbl/db.. might not be using keys..
23:43 <****> Then how do the "child" servers get data back from the "parent" ?
23:43 <****> Do they read its binlogs, or use conventional replication? If so, how do they avoid getting their own updates back?
23:44 <****> the childs are only used to push to the parent... i'm assuming that the parent tbls will be modified to have a column for the child_server_id...
23:44 <****> sv2_ you're talking about multi-master (or peer) replication...Microsoft does this for its Active Directory product, and it is far from simple
23:44 <****> i just need to ensure/validate that the child data will be written and is successfully written..
23:45 <****> and that only works (mostly) because LDAP updates aren't *nearly* as often and as fast as SQL updates
23:45 <****> adaptr - not multi-master.... a single parent.. multiple children feeding the parent app..
23:45 <****> sv2_ so make the transaction on the parent dependent on a successful return from the child
23:46 <****> the slaves simply update back to the master.." <- which, by definition, makes them something other than slaves
23:46 <****> adaptr - the better term is to think of a hub/spoke model.. as opposed to master/slave...
23:47 <****> each spoke updates the hub...
23:47 <****> the hub doesn't push out to the spoke..
23:47 <****> no, they never do
23:47 <****> it simply doesn't work
23:48 <****> MarkR42: It says SQL syntax error
23:48 <****> sv2_ what do you want ? mysql doesn't have hubs and spokes - it has masters and slaves
23:49 <****> I have to go very soon
23:51 <****> okay
23:52 <****> ShawnRisk: find out what query Coldconfusion is actually sending to the database, and try it manually. This will help.
23:52 <****> adaptr - you're confusing terms... i'm saying my scenario is a spoke/hub situation.. where i have a parent/spoke app, that has to collect data from the child/hub apps running on the other servers..
23:52 <****> I know what it is sending and I put that in the question which is in the URL
23:52 <****> You could use the general query log for this, or perhaps get coldfission to dump the raw query somehow (don't ask me how!)
23:52 <****> sv2_ I am fairly certain I am not the one confusing terms.. you're in #mysql, which does not have the concepts you speak of
23:52 <****> the child/spoke apps are running mysql tbls, and this information needs to be updated/inserted into the parent/hub app..
23:53 <****> ShawnRisk: No, you did not put the raw query, only the Confusion code.
23:53 <****> heh :)
23:53 <****> Find out what Confuscious is actually sending to the DB, and then try that manually.
23:53 <****> It is suppose to put Education & Training in name column and uhuhuh in the page column
23:54 <****> MarkR42 - thanks... got some points to consider/test out.. particularly the issues of what happens when a child shuts down during data update/insert back to the parent..
23:54 <****> is my mySQL code right?
23:54 <****> does anyone know about a mysql meetup in chicago (besides meetup.com's page)
23:54 <****> sv2_: Yes, it could be tricky. Of course if you use transactional tables you could wrap the whole thing in a txn, but then you need to be sure it's committed
23:54 <****> Also an individual update might be too big for a transaction
23:55 <****> well I am out
23:55 <****> talk to you later
23:57 <****> MarkR42 - of course the major issue is how do i really know that i've got all the required data... does the parent pull it.. does the child push it... i really need a way to synch the child systems to the parent's system...
23:58 <****> hey.. out of curiosity... how do i create the "* comment.."
23:59 <****> \m l
--- Log closed Fri Oct 26 00:00:48 2007
Total 27 pages. You are browsing page 27/27.
First :: Prev :: [...] [23] [24] [25] [26] [27] :: Next :: Last