Discussion:
mongodb 3.0 storage improvement
(too old to reply)
Need Help
2015-02-04 19:02:01 UTC
Permalink
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Tyler Brock
2015-02-04 19:21:23 UTC
Permalink
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ66Q86sucmSzjQDjSoPLBCi2cTXe_oGkP1gDhEG-ycwg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Need Help
2015-02-04 19:49:49 UTC
Permalink
Is there any place I can get the correct syntax? It does not recognize
wiredTiger:

2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] git version:
e4c60053b2967e16f765fa25d16aa6d629faa196
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] build info: Linux
build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27
UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: { storage:
{ dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
initAndListen: 18656 Cannot start server with an unknown storage engine:
wiredTiger, terminating
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
<javascript:>.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Tyler Brock
2015-02-04 20:01:25 UTC
Permalink
The documentation explains that particular parameter here:

http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdoption--storageEngine

It should just be "mongod --storageEngine wiredTiger [... other options]"
Post by Need Help
Is there any place I can get the correct syntax? It does not recognize
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] build info: Linux
build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27
UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
wiredTiger, terminating
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%
40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Tiffany
2015-02-04 20:33:56 UTC
Permalink
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdoption--storageEngine
It should just be "mongod --storageEngine wiredTiger [... other options]"
Post by Need Help
Is there any place I can get the correct syntax? It does not recognize
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] build info: Linux
build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3 21:39:27
UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
wiredTiger, terminating
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%
40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com
<https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Tyler Brock
2015-02-04 21:29:27 UTC
Permalink
Ah, yup. That is correct.

However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default. You can tune that parameter and various other ones that affect
compression.
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdoption--storageEngine
It should just be "mongod --storageEngine wiredTiger [... other options]"
Post by Need Help
Is there any place I can get the correct syntax? It does not recognize
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
wiredTiger, terminating
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%
40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com
<https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com
<https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BBgy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Asya Kamsky
2015-02-04 22:12:39 UTC
Permalink
Tiffany:

To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).

Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by default.
You can tune that parameter and various other ones that affect compression.
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdoption--storageEngine
It should just be "mongod --storageEngine wiredTiger [... other options]"
Post by Need Help
Is there any place I can get the correct syntax? It does not recognize
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
wiredTiger, terminating
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not noticed
significant memory save. For mongodb 3.0 release note, it said up to 80%
less storage with compression. Is there any command to compress data to
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BBgy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_dvtVem8HE4GXAkRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Tiffany
2015-02-06 19:46:56 UTC
Permalink
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings in
file size, which is great!

However, our old code of invoking mongo server using Mongo/MongoOptions no
longer works. We have upgraded to mongo-java-driver-3.0.0-beta2.jar. So I
have changed to use MongoClientOptions. Compilation went successfully, but
during execution, we got no such method error:
--------------------------------------------------------------------------------------------
Caused by: java.lang.NoSuchMethodError:
com.mongodb.MongoClientOptions.builder()Lcom/mongodb/MongoClientOptions$Builder;

This is my code:
--------------------------------------------------------------------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);

Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdoption--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan 3
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
initAndListen: 18656 Cannot start server with an unknown storage
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler Brock
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not
noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it said up
to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to compress
data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
an
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
an
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com
.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BBgy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com
.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_dvtVem8HE4GXAkRg%40mail.gmail.com
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CADkJGQcon4UAsnr5oMJH%3D5jesvgWJgqmeQEPFvZ41Fo%3DUZfKaw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Jeff Yemin
2015-02-06 19:55:40 UTC
Permalink
Are you using 3.0.0-beta2 because you want to test it out? If so, thank
you! If not, please use the 2.13.0 driver, which is the one recommended
for production use with the 3.0 server.

As for the NoSuchMethodError, that is usually triggered when the classpath
you use for execution does not match the one you used for compilation. Can
you double check please?

Regards,
Jeff
Post by Tiffany
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings in
file size, which is great!
However, our old code of invoking mongo server using Mongo/MongoOptions no
longer works. We have upgraded to mongo-java-driver-3.0.0-beta2.jar. So I
have changed to use MongoClientOptions. Compilation went successfully, but
--------------------------------------------------------------------------------------------
com.mongodb.MongoClientOptions.builder()Lcom/mongodb/MongoClientOptions$Builder;
--------------------------------------------------------------------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);
Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdoption--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri Jan
3
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
initAndListen: 18656 Cannot start server with an unknown storage
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler Brock
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not
noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it said up
to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to compress
data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885-479c-81d7-30c3497ea4d1%40googlegroups.com
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
<javascript:>.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1-4a8a-b544-9092de43d541%40googlegroups.com
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
<javascript:>.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
an
<javascript:>.
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com
.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
an
<javascript:>.
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BBgy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com
.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
<javascript:>.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_dvtVem8HE4GXAkRg%40mail.gmail.com
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Tiffany
2015-02-06 22:22:24 UTC
Permalink
You are correct, we do have a very strange mongodb jar floating somewhere.
After removing it, the problem went away.

We are using mongo-java-2.13.0.jar now. Thank you very much!

However, we can retrieve the database names, but the contents are empty.
That is, we cannot get any collection names from DB. There is no error
message. Some of the databases are empty, some have collections. We use
Mongo.getDatabaseNames() to get the collection names. Are we supposed to
call different APIs?

Thanks!

----------------------------------------------
Post by Jeff Yemin
Are you using 3.0.0-beta2 because you want to test it out? If so, thank
you! If not, please use the 2.13.0 driver, which is the one recommended
for production use with the 3.0 server.
As for the NoSuchMethodError, that is usually triggered when the classpath
you use for execution does not match the one you used for compilation. Can
you double check please?
Regards,
Jeff
Post by Tiffany
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings in
file size, which is great!
However, our old code of invoking mongo server using Mongo/MongoOptions
no longer works. We have upgraded to mongo-java-driver-3.0.0-beta2.jar.
So I have changed to use MongoClientOptions. Compilation went
------------------------------------------------------------
--------------------------------
Caused by: java.lang.NoSuchMethodError: com.mongodb.
MongoClientOptions.builder()Lcom/mongodb/MongoClientOptions$Builder;
------------------------------------------------------------
--------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);
Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#
cmdoption--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
e4c60053b2967e16f765fa25d16aa6d629faa196
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri
Jan 3
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception in
initAndListen: 18656 Cannot start server with an unknown storage
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler Brock
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not
noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it said
up to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to compress
data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-
0885-479c-81d7-30c3497ea4d1%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-
18b1-4a8a-b544-9092de43d541%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpDC2jzToB-
aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%
2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
an
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%
2BBgy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_
dvtVem8HE4GXAkRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CADkJGQdrCGxQGD0FoksYNPWqoHP0U_B-CVsm4RbobtCR82Cudg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Need Help
2015-02-06 22:37:08 UTC
Permalink
We have upgraded to mongodb 3.0 rc8, we still cannot get the collection
names.

We use Mongo.getDatabaseNames() to get the db list, then use
Mongo.getDB(name).getCollectionNames() to get the collections, which is
always empty.
Post by Tiffany
You are correct, we do have a very strange mongodb jar floating
somewhere. After removing it, the problem went away.
We are using mongo-java-2.13.0.jar now. Thank you very much!
However, we can retrieve the database names, but the contents are empty.
That is, we cannot get any collection names from DB. There is no error
message. Some of the databases are empty, some have collections. We use
Mongo.getDatabaseNames() to get the collection names. Are we supposed to
call different APIs?
Thanks!
----------------------------------------------
Post by Jeff Yemin
Are you using 3.0.0-beta2 because you want to test it out? If so, thank
you! If not, please use the 2.13.0 driver, which is the one recommended
for production use with the 3.0 server.
As for the NoSuchMethodError, that is usually triggered when the
classpath you use for execution does not match the one you used for
compilation. Can you double check please?
Regards,
Jeff
Post by Tiffany
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings in
file size, which is great!
However, our old code of invoking mongo server using Mongo/MongoOptions
no longer works. We have upgraded to mongo-java-driver-3.0.0-beta2.jar.
So I have changed to use MongoClientOptions. Compilation went
------------------------------------------------------------
--------------------------------
Caused by: java.lang.NoSuchMethodError: com.mongodb.
MongoClientOptions.builder()Lcom/mongodb/MongoClientOptions$Builder;
------------------------------------------------------------
--------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);
Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#
cmdoption--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] git
e4c60053b2967e16f765fa25d16aa6d629faa196
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri
Jan 3
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] allocator: tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception
in
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
initAndListen: 18656 Cannot start server with an unknown storage
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler Brock
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not
noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it said
up to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to compress
data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-
0885-479c-81d7-30c3497ea4d1%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-
18b1-4a8a-b544-9092de43d541%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/
CAGFxsbLXoBpDC2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%
2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%
2BBgy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_
dvtVem8HE4GXAkRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Jeff Yemin
2015-02-07 00:20:27 UTC
Permalink
I'm not sure what the problem is without more information. I can tell you
that we have an integration test for this, which you can see here
<https://github.com/mongodb/mongo-java-driver/blob/r2.13.0/src/test/com/mongodb/DBCollectionTest.java#L280-288>,
and we run this test (and all others) against both of the storage engines
provided in the 3.0 server. See here
<https://jenkins.10gen.com/view/Java/job/mongo-java-driver-test-with-storage-engines/43/jdk=HotSpot5,label=linux64,mongodb_configuration=single_server,mongodb_server=30-release,storage_engine=wiredTiger/testReport/com.mongodb/DBCollectionTest/testGetCollectionNames/>
for the latest successful test of the 2.13 branch against the wiredTiger
storage engine.

Since you've had issues already with strange mongo-java-driver jar files
floating around, perhaps there's another one still floating. Any version
of the driver before 2.13.0 is going to return an empty set of collection
names. One way to check is to run your program with the -verbose:class
flag, and it will tell you which jar file every class is loaded from. The
output will look something like this:

[Loaded com.mongodb.DB from
file:/Users/jeff/.m2/repository/org/mongodb/mongo-java-driver/2.12.5/mongo-java-driver-2.12.5.jar]

Please let me know what you find. If there's a bug, we definitely want to
know about it.


Regards,
Jeff
Post by Need Help
We have upgraded to mongodb 3.0 rc8, we still cannot get the collection
names.
We use Mongo.getDatabaseNames() to get the db list, then use
Mongo.getDB(name).getCollectionNames() to get the collections, which is
always empty.
Post by Tiffany
You are correct, we do have a very strange mongodb jar floating
somewhere. After removing it, the problem went away.
We are using mongo-java-2.13.0.jar now. Thank you very much!
However, we can retrieve the database names, but the contents are empty.
That is, we cannot get any collection names from DB. There is no error
message. Some of the databases are empty, some have collections. We use
Mongo.getDatabaseNames() to get the collection names. Are we supposed to
call different APIs?
Thanks!
----------------------------------------------
Post by Jeff Yemin
Are you using 3.0.0-beta2 because you want to test it out? If so, thank
you! If not, please use the 2.13.0 driver, which is the one recommended
for production use with the 3.0 server.
As for the NoSuchMethodError, that is usually triggered when the
classpath you use for execution does not match the one you used for
compilation. Can you double check please?
Regards,
Jeff
Post by Tiffany
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings
in file size, which is great!
However, our old code of invoking mongo server using Mongo/MongoOptions
no longer works. We have upgraded to mongo-java-driver-3.0.0-beta2.jar.
So I have changed to use MongoClientOptions. Compilation went
------------------------------------------------------------
--------------------------------
Caused by: java.lang.NoSuchMethodError: com.mongodb.MongoClientOptions
.builder()Lcom/mongodb/MongoClientOptions$Builder;
------------------------------------------------------------
--------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);
Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit Linux.
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdop
tion--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db version
v3.0.0-rc7
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] git
e4c60053b2967e16f765fa25d16aa6d629faa196
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] build
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri
Jan 3
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] options: {
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten] exception
in
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
initAndListen: 18656 Cannot start server with an unknown storage
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler Brock
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not
noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it said
up to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to
compress data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885
-479c-81d7-30c3497ea4d1%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1
-4a8a-b544-9092de43d541%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpD
C2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%
2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BB
gy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_dvtVem
8HE4GXAkRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%
40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAE_jbC%2BU-6t8R-U_ua9-GzxTpwv1P4%3DVoK46_WBAyoHu35t8vA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Tiffany
2015-02-07 02:20:07 UTC
Permalink
Thank you very much for your help! Some of our jars have incorporated
earlier versions of mongo-java-driver. After I rebuild with
mongo-java-2.13.0, I am able to see collection names now.
Post by Jeff Yemin
I'm not sure what the problem is without more information. I can tell you
that we have an integration test for this, which you can see here
<https://github.com/mongodb/mongo-java-driver/blob/r2.13.0/src/test/com/mongodb/DBCollectionTest.java#L280-288>,
and we run this test (and all others) against both of the storage engines
provided in the 3.0 server. See here
<https://jenkins.10gen.com/view/Java/job/mongo-java-driver-test-with-storage-engines/43/jdk=HotSpot5,label=linux64,mongodb_configuration=single_server,mongodb_server=30-release,storage_engine=wiredTiger/testReport/com.mongodb/DBCollectionTest/testGetCollectionNames/>
for the latest successful test of the 2.13 branch against the wiredTiger
storage engine.
Since you've had issues already with strange mongo-java-driver jar files
floating around, perhaps there's another one still floating. Any version
of the driver before 2.13.0 is going to return an empty set of collection
names. One way to check is to run your program with the -verbose:class
flag, and it will tell you which jar file every class is loaded from. The
[Loaded com.mongodb.DB from
file:/Users/jeff/.m2/repository/org/mongodb/mongo-java-driver/2.12.5/mongo-java-driver-2.12.5.jar]
Please let me know what you find. If there's a bug, we definitely want to
know about it.
Regards,
Jeff
Post by Need Help
We have upgraded to mongodb 3.0 rc8, we still cannot get the collection
names.
We use Mongo.getDatabaseNames() to get the db list, then use
Mongo.getDB(name).getCollectionNames() to get the collections, which is
always empty.
Post by Tiffany
You are correct, we do have a very strange mongodb jar floating
somewhere. After removing it, the problem went away.
We are using mongo-java-2.13.0.jar now. Thank you very much!
However, we can retrieve the database names, but the contents are
empty. That is, we cannot get any collection names from DB. There is no
error message. Some of the databases are empty, some have collections. We
use Mongo.getDatabaseNames() to get the collection names. Are we supposed
to call different APIs?
Thanks!
----------------------------------------------
Post by Jeff Yemin
Are you using 3.0.0-beta2 because you want to test it out? If so,
thank you! If not, please use the 2.13.0 driver, which is the one
recommended for production use with the 3.0 server.
As for the NoSuchMethodError, that is usually triggered when the
classpath you use for execution does not match the one you used for
compilation. Can you double check please?
Regards,
Jeff
Post by Tiffany
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings
in file size, which is great!
However, our old code of invoking mongo server using
Mongo/MongoOptions no longer works. We have upgraded to
mongo-java-driver-3.0.0-beta2.jar. So I have changed to use
MongoClientOptions. Compilation went successfully, but during execution,
------------------------------------------------------------
--------------------------------
Caused by: java.lang.NoSuchMethodError: com.mongodb.MongoClientOptions
.builder()Lcom/mongodb/MongoClientOptions$Builder;
------------------------------------------------------------
--------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);
Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use the
wiredTiger storage engine the snappy compression engine is used, by
default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit
Linux.
Post by Tyler Brock
Post by Tiffany
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdop
tion--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db
version
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
v3.0.0-rc7
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] git
e4c60053b2967e16f765fa25d16aa6d629faa196
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] build
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP Fri
Jan 3
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten]
tcmalloc
{
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten]
exception in
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
initAndListen: 18656 Cannot start server with an unknown storage
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler Brock
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have not
noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it
said up to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to
compress data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
To post to this group, send email to
Visit this group at http://groups.google.com/group
/mongodb-user.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885
-479c-81d7-30c3497ea4d1%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1
-4a8a-b544-9092de43d541%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the
Google Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpD
C2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%
2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BB
gy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/CAOe6dJBhQEca73MaX7-0FQ7wCjYhC5%2BC6_dvtVem
8HE4GXAkRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%
40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAE_jbC%2BU-6t8R-U_ua9-GzxTpwv1P4%3DVoK46_WBAyoHu35t8vA%40mail.gmail.com
<https://groups.google.com/d/msgid/mongodb-user/CAE_jbC%2BU-6t8R-U_ua9-GzxTpwv1P4%3DVoK46_WBAyoHu35t8vA%40mail.gmail.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CADkJGQf_UnHuUgHNijyw%3D0FbKAV4MJG6Qp9KAR3cHYe05zEoHA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
Need Help
2015-02-11 19:32:30 UTC
Permalink
We are done with testing mongodb 3.0 rc8/mongo-java-2.13.0. In general, it
takes about 2/3 less than what used to take in storage, which is great!
The speed is about the same.

I have a question, why are there 2 storage engines? I would presume
everyone wants to save memory, so the compressed version is preferred.
What is the benefit of the older format?

Thanks!
Post by Tiffany
Thank you very much for your help! Some of our jars have incorporated
earlier versions of mongo-java-driver. After I rebuild with
mongo-java-2.13.0, I am able to see collection names now.
Post by Jeff Yemin
I'm not sure what the problem is without more information. I can tell
you that we have an integration test for this, which you can see here
<https://github.com/mongodb/mongo-java-driver/blob/r2.13.0/src/test/com/mongodb/DBCollectionTest.java#L280-288>,
and we run this test (and all others) against both of the storage engines
provided in the 3.0 server. See here
<https://jenkins.10gen.com/view/Java/job/mongo-java-driver-test-with-storage-engines/43/jdk=HotSpot5,label=linux64,mongodb_configuration=single_server,mongodb_server=30-release,storage_engine=wiredTiger/testReport/com.mongodb/DBCollectionTest/testGetCollectionNames/>
for the latest successful test of the 2.13 branch against the wiredTiger
storage engine.
Since you've had issues already with strange mongo-java-driver jar files
floating around, perhaps there's another one still floating. Any version
of the driver before 2.13.0 is going to return an empty set of collection
names. One way to check is to run your program with the -verbose:class
flag, and it will tell you which jar file every class is loaded from. The
[Loaded com.mongodb.DB from
file:/Users/jeff/.m2/repository/org/mongodb/mongo-java-driver/2.12.5/mongo-java-driver-2.12.5.jar]
Please let me know what you find. If there's a bug, we definitely want
to know about it.
Regards,
Jeff
Post by Need Help
We have upgraded to mongodb 3.0 rc8, we still cannot get the collection
names.
We use Mongo.getDatabaseNames() to get the db list, then use
Mongo.getDB(name).getCollectionNames() to get the collections, which is
always empty.
Post by Tiffany
You are correct, we do have a very strange mongodb jar floating
somewhere. After removing it, the problem went away.
We are using mongo-java-2.13.0.jar now. Thank you very much!
However, we can retrieve the database names, but the contents are
empty. That is, we cannot get any collection names from DB. There is no
error message. Some of the databases are empty, some have collections. We
use Mongo.getDatabaseNames() to get the collection names. Are we supposed
to call different APIs?
Thanks!
----------------------------------------------
Post by Jeff Yemin
Are you using 3.0.0-beta2 because you want to test it out? If so,
thank you! If not, please use the 2.13.0 driver, which is the one
recommended for production use with the 3.0 server.
As for the NoSuchMethodError, that is usually triggered when the
classpath you use for execution does not match the one you used for
compilation. Can you double check please?
Regards,
Jeff
Post by Tiffany
We are able to load data into mongodb 3.0 rc7, with about 2/3 savings
in file size, which is great!
However, our old code of invoking mongo server using
Mongo/MongoOptions no longer works. We have upgraded to
mongo-java-driver-3.0.0-beta2.jar. So I have changed to use
MongoClientOptions. Compilation went successfully, but during execution,
------------------------------------------------------------
--------------------------------
Caused by: java.lang.NoSuchMethodError: com.mongodb.
MongoClientOptions.builder()Lcom/mongodb/MongoClientOptions$Builder;
------------------------------------------------------------
--------------------------------
MongoClientOptions mop = MongoClientOptions.builder()
.connectionsPerHost(100)
.connectTimeout(5000)
.build();
mg = new MongoClient(addrs, mop);
Could you please tell me what I have done wrong? Thanks!
Post by Asya Kamsky
To add to what Tyler said - with Wired Tiger the data is compressed on
*disk* - the only compression that happens both on disk *and* in
memory is index prefix compression. However, you still should see
additional improvements in RAM utilization because WiredTiger won't
have the same issue with memory fragmentation that MMAPV1 can have on
some workloads (ones where updates grow documents).
Asya
Post by Tyler Brock
Ah, yup. That is correct.
However, to fully answer your question from before, when you use
the
Post by Tyler Brock
wiredTiger storage engine the snappy compression engine is used,
by default.
Post by Tyler Brock
You can tune that parameter and various other ones that affect
compression.
Post by Tyler Brock
Post by Tiffany
I have found the answer. wiredTiger would not work on 32 bit
Linux.
Post by Tyler Brock
Post by Tiffany
Thanks!
Post by Tyler Brock
http://docs.mongodb.org/v3.0/reference/program/mongod/#cmdop
tion--storageEngine
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
It should just be "mongod --storageEngine wiredTiger [... other
options]"
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Is there any place I can get the correct syntax? It does not
recognize
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] db
version
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
v3.0.0-rc7
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] git
e4c60053b2967e16f765fa25d16aa6d629faa196
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten] build
Linux build15.nj1.10gen.cc 2.6.32-431.3.1.el6.x86_64 #1 SMP
Fri Jan 3
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
21:39:27 UTC 2014 x86_64 BOOST_LIB_VERSION=1_49
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten]
tcmalloc
2015-02-04T11:47:55.498-0800 I CONTROL [initandlisten]
options: {
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
storage: { dbPath: "data/db", engine: "wiredTiger" } }
2015-02-04T11:47:55.530-0800 I STORAGE [initandlisten]
exception in
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
initAndListen: 18656 Cannot start server with an unknown
wiredTiger, terminating
On Wednesday, February 4, 2015 at 11:22:41 AM UTC-8, Tyler
Post by Tyler Brock
Did you start mongod with --storageEngine wiredTiger?
Post by Need Help
We have unpacked large dataset on mongodb 3.0 rc7, we have
not noticed
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
significant memory save. For mongodb 3.0 release note, it
said up to 80%
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
less storage with compression. Is there any command to
compress data to
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
achieve significant momory savings?
--
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
To post to this group, send email to
Visit this group at http://groups.google.com/group
/mongodb-user.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/08d8d639-0885
-479c-81d7-30c3497ea4d1%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
Visit this group at http://groups.google.com/group/mongodb-user
.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/63bc3ebf-18b1
-4a8a-b544-9092de43d541%40googlegroups.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Post by Need Help
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the
Google Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google Groups
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from
it, send an
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLXoBpD
C2jzToB-aTT14Yn3Rz11LT2CFxmMbFTS%3DixwLg%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the
Google Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the
Google Groups
Post by Tyler Brock
Post by Tiffany
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Post by Tiffany
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CADkJGQf3OwXL%
2BHr54iQSJw8qMp3S4gENTwpEPdFXqgkcS-sX6w%40mail.gmail.com.
Post by Tyler Brock
Post by Tiffany
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups
Post by Tyler Brock
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
send an
Post by Tyler Brock
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAGFxsbJ7%2BB
gy6ea_0_-4f6aqQ%3DeicgThMeQs1n_aToNt-_ugNg%40mail.gmail.com.
Post by Tyler Brock
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it,
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAOe6dJBhQEca73MaX7-
0FQ7wCjYhC5%2BC6_dvtVem8HE4GXAkRg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/
msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%
40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/b6b90794-0a68-4eec-a0ba-850a285a1176%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google
Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google
Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/bf8f85d3-d8dd-46b0-9b41-19ea4b07f673%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/CAE_jbC%2BU-6t8R-U_ua9-GzxTpwv1P4%3DVoK46_WBAyoHu35t8vA%40mail.gmail.com
<https://groups.google.com/d/msgid/mongodb-user/CAE_jbC%2BU-6t8R-U_ua9-GzxTpwv1P4%3DVoK46_WBAyoHu35t8vA%40mail.gmail.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/7e38dd91-f7fc-4214-8fac-13d663908f1c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
s.molinari
2015-02-12 07:03:15 UTC
Permalink
This question was also on my mind too.:) Where are the advantages of MMap
over WiredTiger, if WT can perform just as well in any/most use cases?

Scott
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/68ee8bd0-3fb9-4760-b32a-bf0cca4c54ec%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Tyler Brock
2015-02-12 15:22:44 UTC
Permalink
In place update performance (like incrementing a counter) is quite strong
on MMAP.
Post by s.molinari
This question was also on my mind too.:) Where are the advantages of MMap
over WiredTiger, if WT can perform just as well in any/most use cases?
Scott
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/68ee8bd0-3fb9-4760-b32a-bf0cca4c54ec%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/68ee8bd0-3fb9-4760-b32a-bf0cca4c54ec%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAGFxsbLrX66oGwFH1LKHDwpFJOE11QphavrRW8PYV_Hr9qFTcQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
s.molinari
2015-02-12 16:59:09 UTC
Permalink
Is that the only advantage?

Scott
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/d8f0afed-1a34-4934-85c8-3f23a9940f1a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Tyler Brock
2015-02-12 21:19:13 UTC
Permalink
MMAP has been around for a while and is pretty battle tested so we have a
very good understanding of the performance characteristics of it under load
as well as in production environments.
Post by s.molinari
Is that the only advantage?
Scott
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.
http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups
"mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit
https://groups.google.com/d/msgid/mongodb-user/d8f0afed-1a34-4934-85c8-3f23a9940f1a%40googlegroups.com
<https://groups.google.com/d/msgid/mongodb-user/d8f0afed-1a34-4934-85c8-3f23a9940f1a%40googlegroups.com?utm_medium=email&utm_source=footer>
.
For more options, visit https://groups.google.com/d/optout.
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/CAGFxsbL2CT1r4kgxv%2BnhnpydjSodmOfAqv%3DKbazaJOacbwe4tw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
s.molinari
2015-02-13 05:50:14 UTC
Permalink
I think this gets down to the issue better.

It is great we have a choice, it is terrible if we don't have much
information to go on to make that choice.

Things I know.

WT has better concurrency, with document level locking.
WT manages to get along with a lot less disk space through data compression
WT doesn't pre-allocate disk space per DB
WT uses RAM smarter/ better (= saves money)

MMap can do fast in-place updates (not sure if it is better than WT though)
MMap has collection level locking (as of 3.0, which isn't better than
document level locking)

From that little bit of knowledge, all I can come up with is, why use MMap
at all? It almost seems WT is making MMap obsolete.

I guess what is needed is a much better comparison chart, so customers can
make a fairly informed decision on when to use each type of storage engine.
Again, without information on how to make a choice within a product, a
choice becomes a really bad thing for the consumer and in the end, the
product!

Scott
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/34a770c7-01f2-41c8-83d0-191290d9cfd7%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
s.molinari
2015-02-13 06:18:00 UTC
Permalink
Here some Java ODMs btw.:)

http://mongolink.org/

https://github.com/mongodb/morphia

I have no idea if they are good or not.

Scott
--
You received this message because you are subscribed to the Google Groups "mongodb-user"
group.

For other MongoDB technical support options, see: http://www.mongodb.org/about/support/.
---
You received this message because you are subscribed to the Google Groups "mongodb-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to mongodb-user+***@googlegroups.com.
To post to this group, send email to mongodb-***@googlegroups.com.
Visit this group at http://groups.google.com/group/mongodb-user.
To view this discussion on the web visit https://groups.google.com/d/msgid/mongodb-user/c3384583-5025-4d6b-ba69-3c4b983e0f49%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Continue reading on narkive:
Loading...