Single MySQL Query one-to-many efficiency
Clash Royale CLAN TAG#URR8PPP
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty margin-bottom:0;
up vote
2
down vote
favorite
I am fairly inexperienced with the ramifications of doing a single select where joining several tables and there are several one-to-many relationships while also running some built in MySQL functions using column values between tables.
The tables will be fairly large: 10,000 records in the accounts table, 70,0000 records in the locations table, 350,000 in the email_sequences table.
The select I am performing: (from Laravel's query builder)
$interval = $getSheduleInterval($current);
$sql = "SELECT seq.id FROM locations AS loc
JOIN accounts as acc ON acc.id=loc.account_id
JOIN email_sequence AS seq ON loc.id=seq.location_id
WHERE acc.suspended = 0
AND acc.deleted_at IS NULL
AND loc.active = 1
AND seq.immediate = 0
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) >= $interval->start
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) < $interval->end";
$sequents = DB::select($sql);
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Are there going to be any major issues with this single select as I have it currently constructed?
Edit: As requested here is the $getScheduleInterval() code;
// @param object [Takes a instance of Carbon::now()]
public function getScheduleInterval($carbonObj)
$interval = (object);
// round time down to quarter hour
$carbonObj->minute = $carbonObj->minute - ($carbonObj->minute % 15);
$carbonObj->second = 00;
//set start / end
$interval->start = "'$carbonObj->toTimeString()'";
$interval->end = "'$carbonObj->addMinutes(15)->toTimeString()'";
return $interval;
php sql mysql
 |Â
show 1 more comment
up vote
2
down vote
favorite
I am fairly inexperienced with the ramifications of doing a single select where joining several tables and there are several one-to-many relationships while also running some built in MySQL functions using column values between tables.
The tables will be fairly large: 10,000 records in the accounts table, 70,0000 records in the locations table, 350,000 in the email_sequences table.
The select I am performing: (from Laravel's query builder)
$interval = $getSheduleInterval($current);
$sql = "SELECT seq.id FROM locations AS loc
JOIN accounts as acc ON acc.id=loc.account_id
JOIN email_sequence AS seq ON loc.id=seq.location_id
WHERE acc.suspended = 0
AND acc.deleted_at IS NULL
AND loc.active = 1
AND seq.immediate = 0
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) >= $interval->start
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) < $interval->end";
$sequents = DB::select($sql);
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Are there going to be any major issues with this single select as I have it currently constructed?
Edit: As requested here is the $getScheduleInterval() code;
// @param object [Takes a instance of Carbon::now()]
public function getScheduleInterval($carbonObj)
$interval = (object);
// round time down to quarter hour
$carbonObj->minute = $carbonObj->minute - ($carbonObj->minute % 15);
$carbonObj->second = 00;
//set start / end
$interval->start = "'$carbonObj->toTimeString()'";
$interval->end = "'$carbonObj->addMinutes(15)->toTimeString()'";
return $interval;
php sql mysql
where is$interval
defined? Is$intervals
an array, which is then traversed in a loop, wherein$interval
is the iterator variable?
â Sam Onela
Jan 26 at 19:17
The$interval
is a standard object.$interval->start
the current time rounded down to nearest quarter hour.$interval->end
current time plus 15 minutes. e.g.12:00:00
12:15:00.
It does not change for the entire query nor in a loop.
â skribe
Jan 26 at 19:32
Thanks for that information, however it still isn't clear where$interval
is defined... Please edit your post to include a definition/assignment of$interval
. If I was to try to run that code (presuming I had the DB configured), I would most likely receive an error stating that$interval
was undefined. Perhaps having a definition for the function at$getSheduleIntervals
and$current
would also be helpful.
â Sam Onela
Jan 26 at 19:40
I don't feel like it is all that relevant, but I appreciate the help, so I have added the code that calculates the$interval
â skribe
Jan 26 at 19:53
1
AH! Now I see some how I have a typo and that is why you were asking where 'interval' was defined. The$intervals
at the top should be simply$interval.
My greatest apologies.
â skribe
Jan 26 at 20:05
 |Â
show 1 more comment
up vote
2
down vote
favorite
up vote
2
down vote
favorite
I am fairly inexperienced with the ramifications of doing a single select where joining several tables and there are several one-to-many relationships while also running some built in MySQL functions using column values between tables.
The tables will be fairly large: 10,000 records in the accounts table, 70,0000 records in the locations table, 350,000 in the email_sequences table.
The select I am performing: (from Laravel's query builder)
$interval = $getSheduleInterval($current);
$sql = "SELECT seq.id FROM locations AS loc
JOIN accounts as acc ON acc.id=loc.account_id
JOIN email_sequence AS seq ON loc.id=seq.location_id
WHERE acc.suspended = 0
AND acc.deleted_at IS NULL
AND loc.active = 1
AND seq.immediate = 0
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) >= $interval->start
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) < $interval->end";
$sequents = DB::select($sql);
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Are there going to be any major issues with this single select as I have it currently constructed?
Edit: As requested here is the $getScheduleInterval() code;
// @param object [Takes a instance of Carbon::now()]
public function getScheduleInterval($carbonObj)
$interval = (object);
// round time down to quarter hour
$carbonObj->minute = $carbonObj->minute - ($carbonObj->minute % 15);
$carbonObj->second = 00;
//set start / end
$interval->start = "'$carbonObj->toTimeString()'";
$interval->end = "'$carbonObj->addMinutes(15)->toTimeString()'";
return $interval;
php sql mysql
I am fairly inexperienced with the ramifications of doing a single select where joining several tables and there are several one-to-many relationships while also running some built in MySQL functions using column values between tables.
The tables will be fairly large: 10,000 records in the accounts table, 70,0000 records in the locations table, 350,000 in the email_sequences table.
The select I am performing: (from Laravel's query builder)
$interval = $getSheduleInterval($current);
$sql = "SELECT seq.id FROM locations AS loc
JOIN accounts as acc ON acc.id=loc.account_id
JOIN email_sequence AS seq ON loc.id=seq.location_id
WHERE acc.suspended = 0
AND acc.deleted_at IS NULL
AND loc.active = 1
AND seq.immediate = 0
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) >= $interval->start
AND TIME(CONVERT_TZ(seq.schedule_time, 'UTC', loc.timezone)) < $interval->end";
$sequents = DB::select($sql);
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Are there going to be any major issues with this single select as I have it currently constructed?
Edit: As requested here is the $getScheduleInterval() code;
// @param object [Takes a instance of Carbon::now()]
public function getScheduleInterval($carbonObj)
$interval = (object);
// round time down to quarter hour
$carbonObj->minute = $carbonObj->minute - ($carbonObj->minute % 15);
$carbonObj->second = 00;
//set start / end
$interval->start = "'$carbonObj->toTimeString()'";
$interval->end = "'$carbonObj->addMinutes(15)->toTimeString()'";
return $interval;
php sql mysql
edited Jan 26 at 20:05
asked Jan 25 at 13:20
skribe
1134
1134
where is$interval
defined? Is$intervals
an array, which is then traversed in a loop, wherein$interval
is the iterator variable?
â Sam Onela
Jan 26 at 19:17
The$interval
is a standard object.$interval->start
the current time rounded down to nearest quarter hour.$interval->end
current time plus 15 minutes. e.g.12:00:00
12:15:00.
It does not change for the entire query nor in a loop.
â skribe
Jan 26 at 19:32
Thanks for that information, however it still isn't clear where$interval
is defined... Please edit your post to include a definition/assignment of$interval
. If I was to try to run that code (presuming I had the DB configured), I would most likely receive an error stating that$interval
was undefined. Perhaps having a definition for the function at$getSheduleIntervals
and$current
would also be helpful.
â Sam Onela
Jan 26 at 19:40
I don't feel like it is all that relevant, but I appreciate the help, so I have added the code that calculates the$interval
â skribe
Jan 26 at 19:53
1
AH! Now I see some how I have a typo and that is why you were asking where 'interval' was defined. The$intervals
at the top should be simply$interval.
My greatest apologies.
â skribe
Jan 26 at 20:05
 |Â
show 1 more comment
where is$interval
defined? Is$intervals
an array, which is then traversed in a loop, wherein$interval
is the iterator variable?
â Sam Onela
Jan 26 at 19:17
The$interval
is a standard object.$interval->start
the current time rounded down to nearest quarter hour.$interval->end
current time plus 15 minutes. e.g.12:00:00
12:15:00.
It does not change for the entire query nor in a loop.
â skribe
Jan 26 at 19:32
Thanks for that information, however it still isn't clear where$interval
is defined... Please edit your post to include a definition/assignment of$interval
. If I was to try to run that code (presuming I had the DB configured), I would most likely receive an error stating that$interval
was undefined. Perhaps having a definition for the function at$getSheduleIntervals
and$current
would also be helpful.
â Sam Onela
Jan 26 at 19:40
I don't feel like it is all that relevant, but I appreciate the help, so I have added the code that calculates the$interval
â skribe
Jan 26 at 19:53
1
AH! Now I see some how I have a typo and that is why you were asking where 'interval' was defined. The$intervals
at the top should be simply$interval.
My greatest apologies.
â skribe
Jan 26 at 20:05
where is
$interval
defined? Is$intervals
an array, which is then traversed in a loop, wherein $interval
is the iterator variable?â Sam Onela
Jan 26 at 19:17
where is
$interval
defined? Is$intervals
an array, which is then traversed in a loop, wherein $interval
is the iterator variable?â Sam Onela
Jan 26 at 19:17
The
$interval
is a standard object. $interval->start
the current time rounded down to nearest quarter hour. $interval->end
current time plus 15 minutes. e.g. 12:00:00
12:15:00.
It does not change for the entire query nor in a loop.â skribe
Jan 26 at 19:32
The
$interval
is a standard object. $interval->start
the current time rounded down to nearest quarter hour. $interval->end
current time plus 15 minutes. e.g. 12:00:00
12:15:00.
It does not change for the entire query nor in a loop.â skribe
Jan 26 at 19:32
Thanks for that information, however it still isn't clear where
$interval
is defined... Please edit your post to include a definition/assignment of $interval
. If I was to try to run that code (presuming I had the DB configured), I would most likely receive an error stating that $interval
was undefined. Perhaps having a definition for the function at $getSheduleIntervals
and $current
would also be helpful.â Sam Onela
Jan 26 at 19:40
Thanks for that information, however it still isn't clear where
$interval
is defined... Please edit your post to include a definition/assignment of $interval
. If I was to try to run that code (presuming I had the DB configured), I would most likely receive an error stating that $interval
was undefined. Perhaps having a definition for the function at $getSheduleIntervals
and $current
would also be helpful.â Sam Onela
Jan 26 at 19:40
I don't feel like it is all that relevant, but I appreciate the help, so I have added the code that calculates the
$interval
â skribe
Jan 26 at 19:53
I don't feel like it is all that relevant, but I appreciate the help, so I have added the code that calculates the
$interval
â skribe
Jan 26 at 19:53
1
1
AH! Now I see some how I have a typo and that is why you were asking where 'interval' was defined. The
$intervals
at the top should be simply $interval.
My greatest apologies.â skribe
Jan 26 at 20:05
AH! Now I see some how I have a typo and that is why you were asking where 'interval' was defined. The
$intervals
at the top should be simply $interval.
My greatest apologies.â skribe
Jan 26 at 20:05
 |Â
show 1 more comment
1 Answer
1
active
oldest
votes
up vote
1
down vote
accepted
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Does that mean running a query to select data from each table and then subsequent queries to select the affiliated data? If so, repeated (redundant) queries (i.e. on one table where only a WHERE
condition changes) can lead to poor performance. But, if the associated data can be shared across records (e.g. multiple accounts have the same location) then it might be better to have one query per table and then look up records in various result sets when needed.
If paging can be integrated, for example: populate the first $n$ results, where $n$ can be 20, 40, 60, etc. then the query with the joined tables might be optimal.
Are there going to be any major issues with this single select as I have it currently constructed?
The query as it is above might likely take a while, given the high number of records in each table. But as mentioned above, paging would likely improve the situation greatly.
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
okay - I should have been more clear: by redundant queries I meant queries to one table where only aWHERE
condition changes. I have updated the explanation.
â Sam Onela
Jan 26 at 23:21
add a comment |Â
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
1
down vote
accepted
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Does that mean running a query to select data from each table and then subsequent queries to select the affiliated data? If so, repeated (redundant) queries (i.e. on one table where only a WHERE
condition changes) can lead to poor performance. But, if the associated data can be shared across records (e.g. multiple accounts have the same location) then it might be better to have one query per table and then look up records in various result sets when needed.
If paging can be integrated, for example: populate the first $n$ results, where $n$ can be 20, 40, 60, etc. then the query with the joined tables might be optimal.
Are there going to be any major issues with this single select as I have it currently constructed?
The query as it is above might likely take a while, given the high number of records in each table. But as mentioned above, paging would likely improve the situation greatly.
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
okay - I should have been more clear: by redundant queries I meant queries to one table where only aWHERE
condition changes. I have updated the explanation.
â Sam Onela
Jan 26 at 23:21
add a comment |Â
up vote
1
down vote
accepted
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Does that mean running a query to select data from each table and then subsequent queries to select the affiliated data? If so, repeated (redundant) queries (i.e. on one table where only a WHERE
condition changes) can lead to poor performance. But, if the associated data can be shared across records (e.g. multiple accounts have the same location) then it might be better to have one query per table and then look up records in various result sets when needed.
If paging can be integrated, for example: populate the first $n$ results, where $n$ can be 20, 40, 60, etc. then the query with the joined tables might be optimal.
Are there going to be any major issues with this single select as I have it currently constructed?
The query as it is above might likely take a while, given the high number of records in each table. But as mentioned above, paging would likely improve the situation greatly.
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
okay - I should have been more clear: by redundant queries I meant queries to one table where only aWHERE
condition changes. I have updated the explanation.
â Sam Onela
Jan 26 at 23:21
add a comment |Â
up vote
1
down vote
accepted
up vote
1
down vote
accepted
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Does that mean running a query to select data from each table and then subsequent queries to select the affiliated data? If so, repeated (redundant) queries (i.e. on one table where only a WHERE
condition changes) can lead to poor performance. But, if the associated data can be shared across records (e.g. multiple accounts have the same location) then it might be better to have one query per table and then look up records in various result sets when needed.
If paging can be integrated, for example: populate the first $n$ results, where $n$ can be 20, 40, 60, etc. then the query with the joined tables might be optimal.
Are there going to be any major issues with this single select as I have it currently constructed?
The query as it is above might likely take a while, given the high number of records in each table. But as mentioned above, paging would likely improve the situation greatly.
I have seen (read) where in some instances it is more efficient to perform several queries and process the result of each in between rather than a complex SELECT query where several one-to-many or many-to-one relationships are involved.
Does that mean running a query to select data from each table and then subsequent queries to select the affiliated data? If so, repeated (redundant) queries (i.e. on one table where only a WHERE
condition changes) can lead to poor performance. But, if the associated data can be shared across records (e.g. multiple accounts have the same location) then it might be better to have one query per table and then look up records in various result sets when needed.
If paging can be integrated, for example: populate the first $n$ results, where $n$ can be 20, 40, 60, etc. then the query with the joined tables might be optimal.
Are there going to be any major issues with this single select as I have it currently constructed?
The query as it is above might likely take a while, given the high number of records in each table. But as mentioned above, paging would likely improve the situation greatly.
edited Feb 5 at 6:46
answered Jan 26 at 18:54
Sam Onela
5,88461545
5,88461545
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
okay - I should have been more clear: by redundant queries I meant queries to one table where only aWHERE
condition changes. I have updated the explanation.
â Sam Onela
Jan 26 at 23:21
add a comment |Â
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
okay - I should have been more clear: by redundant queries I meant queries to one table where only aWHERE
condition changes. I have updated the explanation.
â Sam Onela
Jan 26 at 23:21
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
Here is one article by Jeff Atwood blog.codinghorror.com/all-abstractions-are-failed-abstractions It is a fairly different situation but I was wondering if the same principles might apply. --- Also I don't see how the queries could be considered 'redundant.' It would be doing one query to get active accounts, another for active locations, then processing those and making additional queries base on the results etc.
â skribe
Jan 26 at 19:42
okay - I should have been more clear: by redundant queries I meant queries to one table where only a
WHERE
condition changes. I have updated the explanation.â Sam Onela
Jan 26 at 23:21
okay - I should have been more clear: by redundant queries I meant queries to one table where only a
WHERE
condition changes. I have updated the explanation.â Sam Onela
Jan 26 at 23:21
add a comment |Â
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fcodereview.stackexchange.com%2fquestions%2f185970%2fsingle-mysql-query-one-to-many-efficiency%23new-answer', 'question_page');
);
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
where is
$interval
defined? Is$intervals
an array, which is then traversed in a loop, wherein$interval
is the iterator variable?â Sam Onela
Jan 26 at 19:17
The
$interval
is a standard object.$interval->start
the current time rounded down to nearest quarter hour.$interval->end
current time plus 15 minutes. e.g.12:00:00
12:15:00.
It does not change for the entire query nor in a loop.â skribe
Jan 26 at 19:32
Thanks for that information, however it still isn't clear where
$interval
is defined... Please edit your post to include a definition/assignment of$interval
. If I was to try to run that code (presuming I had the DB configured), I would most likely receive an error stating that$interval
was undefined. Perhaps having a definition for the function at$getSheduleIntervals
and$current
would also be helpful.â Sam Onela
Jan 26 at 19:40
I don't feel like it is all that relevant, but I appreciate the help, so I have added the code that calculates the
$interval
â skribe
Jan 26 at 19:53
1
AH! Now I see some how I have a typo and that is why you were asking where 'interval' was defined. The
$intervals
at the top should be simply$interval.
My greatest apologies.â skribe
Jan 26 at 20:05