How can i make my social network app more efficient in storing and retriving the Data?

Multi tool use
up vote
3
down vote
favorite
I am working on a social network app from scratch,
I designed my database (choosing Mysql) to store and retrieve data
The problem starts when I am posting videos and photos and when data become larger and larger when I am waiting to view news feeds (depending on sql query that brings the last posts from friends ans Pages).
The question is :
How can I manage and handle the big data, and how can I make the news feeds service more efficient ?
What do you think of using (Real-time) Databases from Firebase?
mysql

New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
up vote
3
down vote
favorite
I am working on a social network app from scratch,
I designed my database (choosing Mysql) to store and retrieve data
The problem starts when I am posting videos and photos and when data become larger and larger when I am waiting to view news feeds (depending on sql query that brings the last posts from friends ans Pages).
The question is :
How can I manage and handle the big data, and how can I make the news feeds service more efficient ?
What do you think of using (Real-time) Databases from Firebase?
mysql

New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
up vote
3
down vote
favorite
up vote
3
down vote
favorite
I am working on a social network app from scratch,
I designed my database (choosing Mysql) to store and retrieve data
The problem starts when I am posting videos and photos and when data become larger and larger when I am waiting to view news feeds (depending on sql query that brings the last posts from friends ans Pages).
The question is :
How can I manage and handle the big data, and how can I make the news feeds service more efficient ?
What do you think of using (Real-time) Databases from Firebase?
mysql

New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
I am working on a social network app from scratch,
I designed my database (choosing Mysql) to store and retrieve data
The problem starts when I am posting videos and photos and when data become larger and larger when I am waiting to view news feeds (depending on sql query that brings the last posts from friends ans Pages).
The question is :
How can I manage and handle the big data, and how can I make the news feeds service more efficient ?
What do you think of using (Real-time) Databases from Firebase?
mysql

mysql

New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
edited Nov 7 at 12:54


KENdi
5,6492821
5,6492821
New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked Nov 7 at 6:01


Qusai Azzam
417
417
New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Qusai Azzam is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
up vote
2
down vote
accepted
If you're thinking about putting up Firebase as your choice for your database, then there's nothing wrong with that. Firebase realtime database is a very secure and great option.
Firebase gives you functionality like analytics, databases, messaging and crash reporting so you can move quickly and focus on your users.
Firebase is built on Google infrastructure and scales automatically, for even the largest apps.
And on top of that, many great apps do use Firebase as their backend.
I'd say to know more, you can just start with a demo project on Firebase to learn how the things happen with Firebase, and after learning, start using it as backend for your social app.
Just go to Firebase Console and start with your own project. To learn how to use Firebase, do refer Firebase docs and if stuck, StackOverflow is always there.
If you want to get some inner details, I have some repositories on GitHub, that might help you in understanding about Firebase and the security rules and other important things.
Demo App
Firebase Security Rules
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
|
show 1 more comment
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
up vote
2
down vote
accepted
If you're thinking about putting up Firebase as your choice for your database, then there's nothing wrong with that. Firebase realtime database is a very secure and great option.
Firebase gives you functionality like analytics, databases, messaging and crash reporting so you can move quickly and focus on your users.
Firebase is built on Google infrastructure and scales automatically, for even the largest apps.
And on top of that, many great apps do use Firebase as their backend.
I'd say to know more, you can just start with a demo project on Firebase to learn how the things happen with Firebase, and after learning, start using it as backend for your social app.
Just go to Firebase Console and start with your own project. To learn how to use Firebase, do refer Firebase docs and if stuck, StackOverflow is always there.
If you want to get some inner details, I have some repositories on GitHub, that might help you in understanding about Firebase and the security rules and other important things.
Demo App
Firebase Security Rules
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
|
show 1 more comment
up vote
2
down vote
accepted
If you're thinking about putting up Firebase as your choice for your database, then there's nothing wrong with that. Firebase realtime database is a very secure and great option.
Firebase gives you functionality like analytics, databases, messaging and crash reporting so you can move quickly and focus on your users.
Firebase is built on Google infrastructure and scales automatically, for even the largest apps.
And on top of that, many great apps do use Firebase as their backend.
I'd say to know more, you can just start with a demo project on Firebase to learn how the things happen with Firebase, and after learning, start using it as backend for your social app.
Just go to Firebase Console and start with your own project. To learn how to use Firebase, do refer Firebase docs and if stuck, StackOverflow is always there.
If you want to get some inner details, I have some repositories on GitHub, that might help you in understanding about Firebase and the security rules and other important things.
Demo App
Firebase Security Rules
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
|
show 1 more comment
up vote
2
down vote
accepted
up vote
2
down vote
accepted
If you're thinking about putting up Firebase as your choice for your database, then there's nothing wrong with that. Firebase realtime database is a very secure and great option.
Firebase gives you functionality like analytics, databases, messaging and crash reporting so you can move quickly and focus on your users.
Firebase is built on Google infrastructure and scales automatically, for even the largest apps.
And on top of that, many great apps do use Firebase as their backend.
I'd say to know more, you can just start with a demo project on Firebase to learn how the things happen with Firebase, and after learning, start using it as backend for your social app.
Just go to Firebase Console and start with your own project. To learn how to use Firebase, do refer Firebase docs and if stuck, StackOverflow is always there.
If you want to get some inner details, I have some repositories on GitHub, that might help you in understanding about Firebase and the security rules and other important things.
Demo App
Firebase Security Rules
If you're thinking about putting up Firebase as your choice for your database, then there's nothing wrong with that. Firebase realtime database is a very secure and great option.
Firebase gives you functionality like analytics, databases, messaging and crash reporting so you can move quickly and focus on your users.
Firebase is built on Google infrastructure and scales automatically, for even the largest apps.
And on top of that, many great apps do use Firebase as their backend.
I'd say to know more, you can just start with a demo project on Firebase to learn how the things happen with Firebase, and after learning, start using it as backend for your social app.
Just go to Firebase Console and start with your own project. To learn how to use Firebase, do refer Firebase docs and if stuck, StackOverflow is always there.
If you want to get some inner details, I have some repositories on GitHub, that might help you in understanding about Firebase and the security rules and other important things.
Demo App
Firebase Security Rules
answered Nov 8 at 3:47


PradyumanDixit
1,7971718
1,7971718
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
|
show 1 more comment
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
thanks for your great answer, actually there are many parameter we must consider to scale the social network, like the feed and how i am gonna manage the Feeds which are the new posts of the users, the most important thing is , How fast can i feed the users ? and how often i should call the feed function and Update the users last feeds ? i think this relate to the query (how much it's clean). in Relational (DBMS) we can do tuning to increase the performance, what is the critical limit of Firebase ? and how can i control it without losing high performance ?
– Qusai Azzam
Nov 8 at 9:40
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
@QusaiAzzam glad that you found my answer worthwhile. Well, Firebase is very fast, probably the fastest database option there is, provided you use the searching in a structured way. Firebase is based on nosql and hence there is not everything like in RDBMS and sql, but that never lets Firebase lag behind. Because you can structure your nodes and child nodes always in such a way that can suit you to bring the data in the most optimised way possible. So rest assured, Firebase would not be giving you up in terms of speed. But it would be good to dig in a bit more on their official website.
– PradyumanDixit
Nov 8 at 10:51
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
Also depending on your structure and your way, you can always do something that can optimise your performance, in almost every case. For example, you can create a node named feed, in which you can put sub nodes with imageURLs which are in order of your situation. Also I'd say do search out more to find how to do things with Firebase even more nicely :)
– PradyumanDixit
Nov 8 at 10:57
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
i really appreciate that, actually i have made research but you know the knowledge that (don't know it until you try it), i have got advises to go with (Node.js + MongoDB) or (rethinkdB) but after doing research, i prefer to go with Firebase (Due to many things) such as : Sdks: they are supporting many platforms Availability, scale-ability, High performance, supporting Instant Messaging, Cloud Storage .. that's make it a preferred choice over all , there are also other Nosql Databases such as HBase, Cassandra and really worth to read about them.
– Qusai Azzam
Nov 8 at 15:38
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
Absolutely @QusaiAzzam. If you found my answer useful, consider marking it as correct, this helps future stack overflow readers too and I'd appreciate that, Cheers! :)
– PradyumanDixit
Nov 9 at 3:17
|
show 1 more comment
Qusai Azzam is a new contributor. Be nice, and check out our Code of Conduct.
Qusai Azzam is a new contributor. Be nice, and check out our Code of Conduct.
Qusai Azzam is a new contributor. Be nice, and check out our Code of Conduct.
Qusai Azzam is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53184280%2fhow-can-i-make-my-social-network-app-more-efficient-in-storing-and-retriving-the%23new-answer', 'question_page');
}
);
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
V,L1NlAV UvZO1i5dbtCepyN8sO,2,QstECeVmrYNLDrPgs 3 r v tfTu8X8qcL3K3Nj,OGK6Ak9 jJILYD2DKiwfx d